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ABSTRACT 


The purpose of this thesis is to provide a flexible 
guide for the project manager, to be used in the prepara- 
tion of the Defense Systems Acquisition Review Council 
(DSARC) presentation. The authors have emphasized factors 
which relate to the non-technical aspects of the presenta- 
tion because they believe knowledge of these characteris- 
tics will substantially aid the project manager. Technical 
considerations which comprise the framework of any project 
are also included, but only from a broad viewpoint. Speci- 
fic detail was avoided because each DSARC review will have 
its own areas of emphasis. Therefore, the authors consider 
that a — S! and compilation of the non-technical and 
technical factors, which this thesis accomplishes, will 
provide the project manager a base from which to direct 


the preparation of a DSARC presentation. 
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2s E NL RODUCTION 


The review conducted by the Defense Systems Acquisition 
Review Council (DSARC) at key system decision points in the 
топ process is held for the purpose of ensuring 
that the service has a viable program and is ready to pro- 
ceed to the next phase of acquisition. It is the responsi- 
bility of the project manager to provide the DSARC with the 
pertinent information it needs to make its recommendations 
regarding the program to the Deputy Secretary of Defense 
(DEPSECDEF). The DEPSECDEF then makes the key system de- 
cision (proceed, modify, or cancel) based in part on the 
DSARC's recommendation. This high level decision hinges on 
the effective, impressive, and mee dees ble presentation 
by the project manager. He must use all the facilities 
available to him to ee the DSARC. 

The initial concept of this thesis was to develop a 
@m@ecklist to assist a Navy project manager in his prepara- 
elon of a DSARC аа гон This concept evolved because 
the Navy does not use an official checklist in preparing 
for a DSARC and in the early stages of thesis research the 
authors considered such a checklist to be an important tool 
for use by a project manager. 

After a significant period of research the development 
of a “cook-book" type of checklist was deemed inappropriate 


Because of the variability with which the DSARC must 


~ 





consider each program and each key system decision; a de- 
lead, specific checklist had little meaning. It was still 
Considered, however, that a set of basic guidelines, i.e., 

a flexible guide, was needed by the Navy project manager. 

Further research indicated that the technical aspects 
of the DSARC presentation were considered in Air Force and 
Army checklists, but these often immersed themselves in de- 
кај: and did not address the non-technical considerations іп 
the preparation of a DSARC presentation. Any key system 
decision is a high level problem which involves behavioral, 
legal, political, and other non-technical considerations as 
well as the technical ones. These considerations all 
directly affect defense management and decision-making. The 
project manager's presentation will be more effective if he 
is aware of the importance of knowing how to improve group 
Borer-action through effective communication. This is accon- 
plished by possessing a knowledge of the groups involved, 
the background for decision-making, and the effects of est ıb- 
lished procedures. 

The authors oa that a flexible guide which 
emphasized the non-technical aspects of a DSARC presentation 
and generalized the technical aspects would provide the 
greatest assistance to a project manager, in any service, in 
his preparation of a DSARC presentation. This thesis pro- 
vides the project manager such a guide. 

For the purpose of this thesis, the DSARC review is con- 


sidered to be the review conducted just prior to any one of 





the three key system decisions addressed in DOD Directive 
Ment, i.e., program initiation, transition to engineering 
development, or transistion to production., This generaliza- 
tion is made specifically to emphasize the level of decision- 
making and to de-emphasize the detail pertinent to individual 
key system decisions. 

After presenting a brief history of defense decision- 
making and describing the evolution of the DSARC process, 
the methods currently used by the services in preparing ror 
a DSARC review are discussed. Then the authors’ considera- 
tions resulting from: (1) personal interviews with DOD per- 
Semel, (2) the analysis of existing checklists and (2) the 
study of current directives are presented with the intention 
of showing why knowledge of these considerations is necessary 
in preparing for a DSARC. 

The final chapter cf the thesis is a synoptic presenta- 
tion of the considerations discussed previously; organized 
ШШ а form which can be readily utilized by the project 
manager in fulfilling his responsibility for DSARC evolu- 


tions, 
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ИШЕК ООЛ УОН ОКУ ТИЕ DEFENSE SYSTEMS 


Ev ACOUISITION REVIEW COUNCIL 


ESSO PRE-DOD DIRECTIVE 5000.1 
Evolution of the Decision-Making Process 

Prior to 1947, decisions regarding defense procure- 
ment rested primarily with the two executive departments 
associated with defense, the Department of War (Army and 
Army Air Corps) and the Department of the Navy (Navy and 
Пе пе Corps). Since their problems were in distinctly 
different operational areas and were of different magnitude, 
these two departments worked independently with little co- 
Ordination regarding system acquisition. 

As technological capabilities increased and the 
world environment, with increased international tension, 
became more complicated, any decision, regarding which de 


fense system to develop, became more constrained by 


- political considerations than had previously been the cas . 


x 


E -- Before World War II the United States followed a 


Wl icy Of Strategic mobilization. This policy evolved into 
one of deterrence because there existed the capability of 
massive retaliation and, later, controlled response sup- 
ported by nuclear and conventional forces-in-being. Differ- 
ences of opinion arose between the services where areas of 
responsibility concerning strategic operations overlapped. 
Also, technological advancements outpaced the organizational 


and management capabilities of the individual armed services 


10 





and the military departments could not resolve tne conflicts 
that developed. A change in organization and management was 
needed. 

The need for a change resulted in Congress passing 
the National Security Act of 1947 which established 2 new 
level of coordination above the services. Secretary cf War 
Henry L. Stimson had proposed a single unified military de- 
partment. Secretary of the Navy James F. Forrestal opposed 
unification and had proposed a new management layer over the 
two existing military departments. Authority of the new 
level of management, suggested by Secretary Forrestal, was 
Limited to coordination. The National Security Act of 1947 
followed primarily the views of Secretary Forrestal. 

The National Security Act of i947 established three 
executive departments, The Department of the Air Force, the 
Department of the Army and the Department of the Navy. The 
secretaries of the three executive departments became, by 
law, members of the President's cabinet and the Nationel 
security Council. . The Act did not create a Department of 
Defense; the three executive departments were called the 
National Military Establishment. The Head of this organiza- 
tion, however, was called the Secretary of Defense, and he 
ES limited to the exercise of general authority, direction 
and control. The Secretaries of the three military depart- 
ments held the powers not specifically delegated to the 


Secretary of Defense. The Secretary of Defense was 
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designated the principal assistant to the President in all 
matters relating to national security. 

Secretary of the Navy Forrestal became the first 
Secretary of Defense and it was his responsibility to de- 
velop the organization which he had proposed. The follow- 
ing two years of work with the original organization 
indicated that the Defense establishment still needed fur- 
ther refinement. Secretary Forrestal proposed to President 
Truman a change which instituted major milestones in the 
evolution of the responsibilities of the Secretary of Defense. 
Secretary Forrestal's proposal resulted in the National 
Security Act Amendments of 1949. 

The amendments redesignated the National Military 
Establishment as the Department of Defense and established 
it as an executive department of the government. The Secre- 
tary of Defense was provided with full statutory authority 
Bor directing and controlling his department. The Secre- 
taries of the Army, Navy and Air Force iost their cabinet 
Status and the Secretary of Defense's authority and respon- 
sibility was increased. 

In 1953 President Eisenhower expressed his concept 
of the role of the Secretary of Defense when he said that no 
DOD function was independent of the Secretary of Defense. 

Further legislation, the Reorganization Act of 1958 
and an Executive Order in 1961, increased the responsibili- 
ties of the Secretary of Defense and provided him with the 
mecessary power for carrying out his assigned responsibili- 


ties. The Secretary of Defense now had the authority to 
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consolidate, transfer, reassign or abolish functions involv- 
ing common/similar services or supplies, even though such 
functions had been established by statute. The President, 
in his Executive Order of 1961, delegated to the Secretary 
all the functions including the powers, duties and authority 
contained in the Federal Civil Defense Act of 1950. The 
above changes finally placed the Secretary of Defense in a 
powerful position as principal assistant to the President in 
all matters relating to the Department of Defense. 

A system had now evolved where the Secretary of 
Defense decided what course of action to pursue. This was 
a complete alteration of the pre-1947 concept where the 
armed services made the decisions regarding defense acquisi- 
tion. Now, one man, working with his staff and the ser- 
vices, coordinated all efforts with respect to providing a 


system to meet the nation's needs. 


2. Office of the Secretary of Defense (OSD) Involve- 
ment in the Decision-Making Process 


Despite the organizational changes in the Departme it 
of Defense, ө. the introduction of significant policy 
changes by former Secretary of Defense, Robert S. McNamara 
(1961 - 1967), OSD involvement in the system acquisition 
decision-making process was largely that of loosely monitor- 
ing service initiated programs with little on other than 
ministrative, into actual decision-making. 

Charles J. Hitch, in a lecture delivered at the 


Ши тека су of California in April 1965, stated, "although 
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К Шаме no had unification ‘in name’ for almost 18 years, 
ГЕ was little unification ‘in fact" until 1961, except 


I 
ШОС гее агеа<$...." 


These three areas were: (1) unified 
commands, (2) joint contingency plans and (3) putting con- 
trol of the overall level of the defense budget into the 
hands of the civilian Secretaries by dividing the total de- 
fense budget ceiling among the three military departments. 
This left, to each department, the allocation of its budget 
among its own functions, units and activities. 

The Office of the Secretary of Defense, immersed in 
its own problems of organization and operation, provided no 
overall coordination ee functions, military and civil- 
Шап. Each of the four primary assistants to the Secretary 
of Defense had his own sphere of responsibility and often 
did not have time to concern himself with the problems of 
others. These four assistants to the Secretary of Defense 
were the Director of Defense Research and Engineering, DDF 
& E; Assistant Secretary of Defense (Comptroller), ASD 
(COMPT); Assistant Secretary of Defense (Installation and 
Boeistics), ASD(I&L); and the Assistant Secretary of Defense 
(Systems Analysis), ASD(SA). 

"The Director of Defense Research and Engineering 
is the principal advisor and staff assistant to the Secre- 
tary of Defense in the fields of scientific and technical 
matters; basic and applied research; research, development, 


test and evaluation of weapons, weapons systems and defense 


1 › å Modern Design for Defense Decision, A McNamara- 


EBrteh-Enthoven Anthology (Washington, D. C., Industrial 
College of the Armed Forces, 1966), p. 51. 
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егізі: апа design and engineering for suitability, pro- 
omer bility, reliability and maintainability. He supervises 
all research and engineering activities in the Department 
of Defense. 


The Assistant Secretary of Defense (Comptroller) 
advises and assists the Secretary of Defense in the perform- 
ance of the Secretary's programming, budgetary and fiscal 
functions, and organizational and administrative matters 
pertaining to these functions. He provides for the design 
and installation of resource management systems throughout 
DOD, and collects, analyzes and reports resource management 
information for the Secretary of Defense and, as recuired, 
for the Office of Management and Budget, the Congress, the 
General Accounting Office, and other agencies outside DOD. 
He also supervises, directs, and reviews the preparation 
and execution of the DOD budget, and administers services 
pertaining to automatic data processing and central data 
services. 


The Assistant Secretary of Defense (Instaliation 
and Logistics) is the principal staff assistant to the 
Secretary of Defense in fields of material requirements; 
production planning and scheduling; acquisition, inventory 
management, storage, maintenance, distribution, movement 
and disposal of material, supplies, tools and equipment; 
small business matters; transportation, petroleum, and 
other logistical services; supply cataloging, standardiza- 
tion and quality control; commercial and industrial acti- 
ШШЕ Тез and facilities; military construction, including 
Reserve Forces facilities; family housing; real estate and 
real property, including general purpose space; and 
industrial relations. He is also responsible for assess- 
ing the vulnerability of resources to attack damage and 
for international civil emergency planning. 


The Assistant Secretary of Defense (System Analysis) 
reviews, for the Secretary of Defense, quantitative require- 
ments including forces, weapon systems, equipment, personnel, 
and nuclear weapons. He assists the Secretary in the 
mmeciation, monitoring, guiding, and reviewing of require- 
ments studies and cost-effectiveness studies, and encourages 
the use of the best analytical methods throughout the Depart- 
ment of Defense. In addition, he conducts or participates 
in special studies as directed by the Secretary of Defense." 


The above "job descriptions" emphasize the prodi- 


gious responsibility assigned to each principal assistant 


x » Department of the Navy RDT&E Management Guide, 
Part I: System Description (NAVSO P-2457, Rev. 7-72) 


pp. E2-E5. 
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пе Secretary of Defense. It is not surprising that 
each would be involved in his own functions and not ini- 
tiate an involvement with the problems of otners. Prior 
to the McNamara era it appeared that OSD had the respon- 
sibility of monitoring the services in the acquisition 
of defense systems but was unsure of how to manage this 
mesponsibility. 

The policy changes of former Secretary of Defense 
Robert S. McNamara changed but, according to many DOD 
personnel, did not appreciably improve the situation re- 
garding coordination and cooperation between the services 
and OSD. Under McNamara the decision-making process be- 
came centralized at the OSD level. It lacked the quali- 
meee Of “participative management expected by the services. 
secretary McNamara made ail major decisions and apparently 
overmanaged the services to a great ПН The acquisi- 
tion of major defense systems was still undertaken, but 
the brunt of a decision often rested on the results of 
systems Be CU The defense system acquisition process 
continued to lack the overall coordination between functions 
[DDR&E, ASD(COMPT), ASD(I&L) and ASD(SA)] necessary for an 


effective and efficient process. 


ack Raymond, "The McNamara Monarchy," American Defense 


Шоша су. Second Edition, (John Hopkins Press, Baltimore, 


The reader may acquire further information on this subject 


by referring to the text of A Modern Design for Defense 


ШЕСИ Воп, ор. сіг. 
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In 1969 the Office of the Secretary of Defense came 
under new management, Melvin Laird, as Secretary of Defense 
(SECDEF) and David Packard as Deputy Secretary of Defense 
(DEPSECDEF). Secretary Packard was tasked with the responsi- 
bility of improving the defense systems acquisition process 
while Secretary Laird remained concerned with the diplomatic 
aspects of the defense department. It was at this time 
that procedures were put together which had an unequivocal 
impact on defense — acquisition. The impact of this 
is discussed later under Section B of this chapter. 

3. Service Involvement in the Decision-Making Process 

In this section the involvement of the armed ser- 
vices in the systems acquisition decision-making process 
is discussed. It is the responsibility of the military 
services to procure defense systems as approved by the 
Secretary of Defense. This responsibility has always been 
assigned to the services. Based on this defined responsi- 
bility, service involvement in the decision-making process 
has been and should continue to be one of initiation, 
marketing and managing their programs. 

The mus are organized with specific commands 
assigned exact functions for accomplishing procurement. 

Ihe Army and the Navy both operate using a Material Command 
for systems acquisition. Under the Army Materiel Command 
there are seven commodity commands and one test and evalua- 


tion command. The Navy utilizes six system commands under 
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ШЕ Materias Command for acquisition purposes. The Air 
Force assigns the research and systems acquisition function 
Othe Air Force Systems Command and the logistics function 
to the Air Force Logistics Command. The primary purpose 

of the services' material acquisition commands is to 
develop, procure and support defense systems. 

Establishment of the Department of Defense in 1947 
did not have a significant effect on service decision-mak- 
ing. The services, to a large extent, functioned indepen- 
dently in carrying out their responsibilities in systems 
acquisition. The services were still tasked with the over- 
all responsibility of system procurement. The monitoring 
of service procedures and efforts by personnel in the Office 
of the Secretary of Defense did not impact upon service 
procedure. 

Mr. AN when he assumed the position of Secre- 
tary of Defense, felt that he should become intimately in- 
volved in all done To achieve this involvement, Mr. 
McNamara utilized his Systems Analysis office. Since Mr. 

Ma 3uara's specialty was statistical control his avidity for 
systems AUR SIC was ара Some authors infer, as men- 
tioned by McNamara РЦ that his system analysis per- 
Sonnel took much of the decision-making responsibility, 


Mmerticularly initiation of programs, away from the services. 


ріс... DX. 


E ond, OB cit., p: 408 


ИХ Modern Design for Defense Decision, op. cit., р. 16. 
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ШЕ 414 һе always follow the services’! advice in matters of 
service interest. This may have been. However, the efforts 
of the McNamara era did result in some coordinated service 
endeavors. The Planning, Programming, and Budgeting System 
eres) was a major McNamara/Hitch innovation which contri- 
bated Significantly to this ccordination, 

Defense system acquisition, when Mr. Laird and 
Mr. Packard arrived in 1969, was overly centralized. One 
of the effects was low service morale. The new Secretary 
of Defense and Deputy Secretary of Defense believed in a 
participatory style of management and gradually restored 
much of the decision-making responsibility and enthusiasm to 
the services. This new management style established the 
beginning of a dramatic reorganization in systems acquisi- 
tion. The genesis of this reorganization was DOD Directive 


5000.1. 


Pee DOD DIRECTIVE 5000.1 
1. Development of the Directive 

Prior to the actual issuance of DOD Directive 
5000.1, two particularly significant memoranda were issued 
by DEPSECDEF Packard. These memoranda became the basis 
for much of the mechanism and policy used in the final 
directive. The first was the 30 May 1969 Memorandun, 
Establishment of a Defense Systems Acquisition Review 
Council (Appendix A), which resulted from Mr. Packard's 


initial review of system acquisition management in the 
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Department of Defense. The importance of this memorandum 
is discussed under Section C of this chapter entitled 
Ше DSARC". 

Hé Second memorandum, dated 28 May 1970 Policy 
Guidance on Major Weapon System Acquisition (Appendix B), 
was written after a year's study of the acquisition pro- 
cess by Mr. Packard and his staff. This memorandum set the 
final tone for the issuance of the DOD Directive 5000.1. 
New policy guidance in this memorandum concerned system 
acquisition management, conceptual development, full-scale 
development, production, and contracts. In addition, the 
decentralization of management in systems acquisition was 
emphasized. 

Management policies addressed in the 28 May 1970 
Memorandum were aimed primarily at the utilization and 
recognition of talented people in the systems acquisition 
process, Improved procedures for the selection, training, 
use, and recognition of project managers, in parti.ular, 
were addressed as neans of upgrading acquisition managemeit 
within the services. 

The cU: policy change brought forth in the 
28 May 1970 Memorandum emphasized the use of trade-offs. 
The effective use of practical cost, schedule, and perform- 
ance trade-offs, i.e., operating requirements and engineer- 
ing design trade-offs, was delineated as the most important 
Single factor in the cost of developing and acquiring a 


new system. 
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New policy in conceptual development was stressed 
because wrong decisions made during the conceptual phase 
of development are particularly difficult to overcome later 
in the program. Three suggested methods of reducing techni- 
cal uncertainty in the conceptual phase were risk assessment, 
System and hardware proofing, and performance, cost and 
schedule trade-offs. 

Full-scale development policy changes concerned 
themselves with careful planning for risk reduction, mile- 
stone planning to demonstrate achievement of objectives, 
and timely planning for all matters necessary to implement 
Bully operating system., 

The emphasis of production policy changes was 
directed at the following: (1) completed engineering design, 
(2) major problem resolution and (3) demonstration of readi- 
ness for ss by performance testing to the greatest 
possible extent. 

Possibly the most significant change from previous 
uc. noted in ene 28 May 1970 Memorandum concerned con- 
tracting. Total package procurement which basically shifts 
program eT the contractor, had been tested to a limited 
extent and had ай а New policy dictated that the type 
contract be tailored to the risk involved. Cost reimburse- 
ment contracts were recommended for advanced and full-scale 
development and fixed price contracts were recommended for 


production. 
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E Content of the Directive 

With two major building blocks in the new Laird- 
Packard acquisition process established, the DSARC and 
ENPficant new acquisition policy, the formal document, 
DOD Directive 5000.1 (Appendix C), was issued. This docu- 
ment restated the policy previously established and went 
into greater detail in delineating the responsibilities 
of OSD and the DOD components. Additionally, a more de- 
tailed description of program considerations was included. 
These considerations were (1) a statement of the system 
need in operational terms and its repeated challenging, 
(2) consideration of cost parameters to include acquisi- 
tion and life-cycle costs, (3) logistic support, (4) use 
of milestones, (5) assessment of technical uncertainty, 
Mopmeincreased use of test and evaluation, (7) contract 
form consistent with program characteristics, (8) source 
selection considerations and (9) use of realistic 


management information-program control requirements. 


ООО THE DSARC 

Mr. and took a major step in reorganizing the 
DOD approach to system acquisition by establishing the 
Defense System, Acquisition Review Council (DSARC) 
through the 30 May 1969 Memorandum. Rather than total 


utilization of the Development Concept Paper (DCP) 
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се, З a purely formal management and decision-making 


procedure, a process of systematic adversary management 


was instituted to complement the DCP m The char- 


ter for the DSARC included with the 30 May 1969 Memoran- 


dum, addressed the mission, functions, composition, 


authority, responsibilities and finally the administra- 


tion cf the DSARC. 


5 


Briefly, the mission of the DSARC is to review major 


ystem acquisition programs at appropriate and signifi- 


cant milestone decision points to permit coordinated 


evaluation and deliberation among senior managers and to 


assure that complete and objective recommendations are 


8 


given to DEPSECDEF concerning the acquisition of major 


The DCP evolved over a long period of time and the first 
reference to it, per se, is in the 1967 posture statement 
of Secretary of Defense McNamara. All OSD references for 
the actual preparation of DCPs has been informal.  Guide- 
lines for its preparation are supplied in service instru'- 
tions: 


Army = Army Reg. 1000-1 30 June 1972 
asic Policies for System Acquisition" 


Navy - SECNAVINST 5000.1, 13 March 1972 
"System Acquisition in the Department 
of the Navy" 


Air Force - AFSC Pamphlet 800-3, 14 May 1971 
"A Guide for Program Management" 


The authors learned through discussions with key OSD and 
service personnel that the DSARC proceedings are of an 
adversary nature even though the initial intent of the 
DSARC was strictly to coordinate service and OSD efforts. 
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systems. The DSARC recommendations are used by the 
DEPSECDEF as the basis for his decision regarding program 
status. | 

The functions of the DSARC are basically to review 
and evaluate the status of each program just prior to the 
following key system decision points: (1) program initia- 
Beem, (2) transition to full scale development and (Š) 
transition from development to production. The DSARL con- 
ES of the DDRSE, the ASD(I&L), the ASD(COMPT), and the 
ASD(SA). These men are frequently referred to as the 
MRC principals. In addition, other OSD personnel, such 
as the ASD(INTELLIGENCE)and the ASD(TELECOMMUNICATIONS), 
will be involved when the program comes under their cogni- 
гапсе. 

The authority and responsibilities delineated in the 
DARC charter include: (1) who chairs DSARC reviews, (2) 
who chairs additional reviews and how additional reviews 
are called,(3) what programs are to be included in the 
DSARC process amd CA) what aspects are to be considered 
at each of the key system decision reviews. 

The DSARC provides the means for a coordinated effort 
to solve the problems of defense system acquisition. 
During the review, the system project manager brings his 
analysis of program considerations to the attention of 
the DSARC principals in a 30 to 45 minute presentation. 


Examples of these presentations are included as Appendices 
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Шта Е. A period of discussion follows in which the DSARC 
principals ask further questions or present their own argu- 
ments for consideration by the other members of the DSARC. 
During this discussion, the project manager, with detailed 
knowledge of his program coupled with his awareness of the 
non-technical aspects, may be drawn upon to clarify the 
presentation or the information in the DCP. 

Attendance at the DSARC review, though somewhat flexible, 
is generally limited to selected persons. This attendance 
is controlled by DDR&E. 

Finally, after ali the information has been presented 
and analyzed, a recommendation, which will ET ткт Айу 
affect the service's program, is submitted by the DSARC 


BSEDEPSECDEF. 
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ШЕГІ, СОЕ ПЕЕВ ЕРАТА ТОМ FOR DSARC PRESENTATIONS 


In the previous chapter, the evolution of the DSARC was 
discussed. This chapter will discuss the procedures fol- 
lowed by the three services in their preparation for the 
рекс. 

Appendices D and E are examples of actual DSARC presen- 
eons of the Patrol Frigate (PF) Project and the Phalanx 
Close-In Weapon System(CWIS) Project, less the sensitive 
portions, and are provided to show the reader the approaches 
taken By two Navy Project Managers in their DSARC presenta- 
tions. Appendix E has, ine Nadiad with the presentation, a 
memorandum, signed by the Deputy Secretary of Defense, which 
indicates the decision made by the OSD and the rationale 


behind the decision. 


A. BACKGROUND 

DSARC reviews .are held for major and important Depart: 
Bem of Defense system acquisition programs. Criteria for 
the determination of these programs is available in DOD 
Directive 5000.1 (Appendix C). Initiation of the DSARC 
process usually begins by the service informing OSD that 
it is ready for a DSARC on a particular program; however, 
a DSARC may be called at OSD's prerogative whenever OSD 
deems it necessary. An example of this type of DSARC re- 


view might be when new threat information is learned which 
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would make a defense system acquisition program, previously 
Vital, now unnecessary, or when a breech of à previously 
established threshhold is anticipated. 

Prior to the DSARC, the project manager must determine 
what issues are relevant to his program, and how he will 
discuss them. These issues will vary from program to pro- 
gram because each program differs in its purpose and objec- 
tives. There are, however, certain specified decision 
considerations which the services must address in some 
detail. These items are obtained through analysis of DOD 
Directive 5000.1, by meeting with the DSARC principals' 
staffs and from formal and informal a Ihe con- 
siderations upon which the project manager should base his 
presentation are as ous: т 

NEED/THREAT 

ISSUES 

FINANCIAL CONSTRAINTS 
TECHNOLOGICAL CONSTRAINTS 
ALTERNATIVES 

TEST AND EVALUATION 
PROGRAM RISKS 


1 
E the time of this writing OSD was working on a draft 


instruction which would explicitly detail which areas of 
interest the services were to present at each DSARC. 
Informal liaison with OSD personnel indicates that this 
draft instruction is still under study. 

Enese items were obtained from OSD personnel who at the 
time of the interview were involved in analyzing the 
effectiveness of DSARC presentations. 
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OREPATITONATL SUITABILITY 
PROGRAM MANAGEMENT 
PRODUCTION PLAN 

The DSARC expects each one of the above topics to be 
addressed at the level of emphasis determined by the key 
system decision at hand. For exampie, if the key decision 
Шире made by OSD is whether to go into production, it is 
likely that the risks regarding product development may be 
Minor in nature and need not be emphasized. However, the 
test and evaluation status at this phase in the acquisition 
process would be of prime importance. How the program 
manager approaches each of these topics of interest is a 
function of program status, and what the project manager 
 ЕСПет with his service has obtained through liaison 
Meth OSD. This service liaison with OSD at some level 
cannot be overemphasized. 

One conclusion arrived at Бу the authors was that the 
DSARC requires the presentation of sufficient detail to 
make the correct MEER An Det not so much detail 
that the main DSARC issues are obscured. It must be 
remembered бак OSD utilizes the DSARC for high-level 
decision-making, and the services must address the issues 
of importance to the DSARC. As explained to the authors 
by Vice Admiral Eli Reich, Deputy Assistant Secretary of 


Defense (Production, Engineering and Material Acquisition), 





mice a pragmatic approach with the DSARC or you are not 


going to MS 


SERVICE PROCEDURES 
1. Pre-reviews 

The two most significant problems in preparing for 
a DSARC review are: (1) determining the issues to address 
mmm (2) how to address them in a manner acceptable to the 
DSARC. Regarding the issues in which the DSARC is inter- 
ested, the project manager must obtain them through personal 
contact between the services and OSD, either in the form 
E memo, phone calls, or actual face-to-face communication. 
The second problem becomes difficult because the project 
Manager may overlook some of the important aspects of the 
issues, not because he is unfamiliar with the topics, but 
rather because he is too closely involved with the program 
and will tend to address his problems vice the DSARC's. 
This deep involvement may deter him from the aspects of 
Ku issues which are of real importance to the DSARC. 
Both of these areas of concern are dealt with through pre- 
DSARC reviews. 

The project managers whom the authors were for- 
tunate enough to talk with expressed the belief that the 


DSARC requires a pre-DSARC review within their own service 


is philosophy was presented during a personal interview 


with Vice Admiral Eli Reich on 3 November 1973, Washing- 
mon, D. C. 
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~ 


to ensure that all issues are peered. The pre-review 
helps to reinforce explanation of the issues obtained from 
OSD personnel, provides adversary management within the 
service, solidifies program objectives, and will aid the 
project manager in presenting the program to the DSARC, 

The pre-DSARC review allows senior service per- 
sonnel, who have been involved in previous DSARCs, to 
critique the project manager's presentation. These reviews 
put heavy demands on the project manager's time, but should 
guarantee better service credibility at the DSARC because 
reiterations improve the presentation. 

All three services use this manner of preparation. 
An analysis of the respective service instructions indicates 
much activity involved in pre-DSARC reviews. The Vice Chief 
of Staff of the Army and the Vice Chief of Naval Material 
chair their respective review groups. The Air Force con- 
ducts two reviews prior to the DSARC review: (1) Air Staff 
Review chaired by the Deputy Chief of Staff (R & D) and, 
SS Joint Re rs of Air Force and Chief of Staff of the 
Air Force Review. 

Because of the involvement of high level service 


personnel, the pre-DSARC review will aid in identifying 





Попе of the project managers with whom discussions were 
held during the authors’ research trip to Washington, 
D. C., November 1972, were S3A (Deputy), PF (Deputy) 
and PHALANX CIWS. This pre-review concept is also sup- 
ported by Rear Admiral Rowland G. Freeman III, Deputy 
Chief of Naval Material (Procurement and Production) 
(MAT 02). 
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issues and, where necessary, will also ensure that emphasis 
on important technical detail is белс сс. 
mee Checklists 

The Army and the Air Force have developed checklists 
for use by their project managers in preparation for a 
DSARC review. The Air Force checklist (Appendix F) covers 
e requirements of DOD Directive 5000.1. The Army check- 
list (Appendix G) appears to be an expansion of the Air 
Force checklist and is extremely detailed regarding the 
technical aspects of the program. Examples of this are 
electromagnetic compatibility requírements and the descrip- 
tion of value engineering provisions. The authors consider 
both checklists excellent in the technical sense but un- 
balanced in some areas. These checklists are limited in 
their scope - they do not address all factors which the 
authors consider pertinent-in the planning of an effective 
DSARC presentation. The checklists give an excellent pic- 
ture to the project: manager of what he should know about 
his program but do not adequately prepare him for a DSARC 
ИЖ cation, 

The Navy does not use an official checklist because 
it considers the interface between the Navy Material Com- 
mand and the project managers together with the pre-DSARC 


14 


For further information on pre-DSARC reviews consult: 
OPNAVINST 5000.41 dated 15 September 1972 

NAVMATNOTE 5000 dated 10 January 1973 

Army Regulations 15-14 dated 17 January 1973 

Air Force HOI 800-3 (Proposed) 
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Beuys to be sufficient to identify issues in which the 
DSARC is interested. The point made by the Navy was that 
the DSARC's interests vary depending upon the program; 
therefore, the DSARC could not be prepared for by using a 
set of standard specific technical ee Broad 
guidance may be put into a checklist, but that information 
is considered available to Navy project managers through 
the pre-DSARC review. 

This concept, followed by the Navy, makes the 
Success of the program depend on the discussions at various 
review levels to ensure coverage of all the areas of DSARC 
interest. Although eme Air Force and Army checklists tend 
to get too specific, the lack of a Navy checklist provides 
their project managers no initial guidance. 

The project manager's presentation effectiveness 
becomes a function of the experience level of the reviewers 
and, though that aspect is important, without an establis.ed 
set of guidelines, utilization of the reviewer's knowled; °` 
is often lost due to personnel transfers. 

The authors Ре that there should be a base 
for the project manager to begin preparing his presentation 
for the DSARC, and that a broad set of written guidelines 


establish this base. It must be remembered, hewever, that 


1 
This point was made by Admiral Rowland G. Freeman during 


a discussion with him during the author's research trip 
to Washington, D. C. in November 1972. 
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ШИЕ existence of checklists do not, in themselves, ensure 
a good DSARC presentation. The key to an effective pre- 
sentation is in the coordination between OSD, the services 
and the project manager. 
ШІ Non=technical Considerations 
Available checklists, with the possible exception 

of a section on program management, are totally oriented 
toward technical details. However, of primary p el 
mthe authors' opinion,is that there is more to a DSARC 
review than presenting the technical details of the program. 
The non-technical aspects of the presentation must also be 
considered. This point can be made clear by paraphrasing 
a comment made to the authors by a high service official, 
Beet DSARCs are different and the project manager must sell 
his program. He must prove himself capable and then tell 
the DSARC how the job is to be ына” 
ЕЕ The project manager best achieves this task by 

knowing the issues to be addressed and how the views of 

the members of the DSARC are oriented toward his progran. 

The authors submit that the project manager must be aware 

of the following items which do not appear in checklists: 

a. THE EFFECT ON THE PROGRAM OF THE DSARC 
ERINCIPALS AND IHEIR STAFFS 


b. THE USE AND EFFECT OF THE DEVELOPMENT CONCEPT 
PAPER 
oe. ; 
This philosophy was expressed by Dr. Peter Waterman from 


the Office of the Assistant to the Secretary of the Navy 
for R & D, November 1972. 
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ES ТӘРГЕМЕБООИРАТТОМ ТО ARGUE FOR THE PROGRAM 

d. THE PROGRAM IN RELATION TO AN ENTIRE 
MILITARY CAPABILITY 

e, THE BUDGET AND FUNDING PROCESS 

t. INDIS TANCT EXTERNAL AND INTERNAL FACTORS 
AFFECTING THE PROGRAM 
(1) Visibility and exposure 
(Tradition, Parochialism, and Vested 

тетке 5 

C0 Tnertia 

g. THE UNKNOWN 


These items are addressed in detail in Chapter IV. 


С. SUMMARY 

All services attempt to speak to the issues of interest 
to the DSARC as taken from DOD Directive 5000.1. One of 
the questions asked OSD personnel was, "Are the services 
well prepared for the DSARC presentation?" The answer 
received from all.those interviewed was, "Yes," 

Algood technical checklist may be of some importance 
for project managers in their preparation for a DSARC 
presentation. The Air Force and Army have provided their 
project managers with such checklists. The authors con- 
Sider these checklists too technically detailed to pro- 
perly prepare a project manager for a DSARC presentation. 
Contrary to the Navy's viewpoint of not needing a check- 


list however, the authors consider a broad set of written 
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wenes covering broad technical requirements and non- 
een cal considerations important, particularly for the 
inexperienced project manager. 

Though the pre-DSARC reviews seem to be necessary and 
do provide the impetus needed to develop and clarify the 
issues and technical considerations desired by the DSARC, 
the project manager's efforts in preparing for a DSARC 
could only be enhanced by the acceptance and use of a 
broad set of established guidelines, as proposed in the 


mext two chapters. 
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IV. CONSIDERATIONS IN THE PREPARATION 
OF A DSARC PRESENTATION 

There are many factors which must be considered by the 
дес manager in his preparation for a DSARC presentation. 
These factors may be separated into two categories, general 
background factors, which the authors consider to be non- 
technical, and specific material, or the technical items 
discussed in DOD 5000.1. 

The background factors to be discussed in this chapter 
were derived and developed largely through discussions with 
people involved in the DSARC process such as Mr. David 
ШИЕКата, who established the DSARC, Mr. E. J. Nucci, the 
executive secretary of the DSARC, Vice Admiral Eli Reich, 
Deputy Assistant Secretary of Defense (Production Engineer- 
ing and Material Acquisition), several persons with an 
interest similar to that of the authors of assisting pro- 
ject managers in preparing for the DSARC, and several pro- 
ject managers who had experienced DSARC reviews or were 
preparing for them. These background factors as stated in 
part in Chapter III include: 


1. The Project Manager's Approach to the DSARC 
Presentation 


2. The Effect on the Presentation of the DSARC 
Principals and their Staffs 


3. Use and Effect of the Development Concept Paper 
(DCP) 


4. A Firm Foundation to Argue for the Program 
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EE Ihe Program in Relation to an Entire Military 
Capability 


В. The Budget and Funding Process 


M distinct External and Internal Factors Affecting 
the Program 


8. The Unknown 

These factors may not be included specifically in the 
DSARC presentation; en their impact must be understood 
and this understanding should provide the project manager 
with added insisht into the preparation of his DSARC presen- 
tion. 

Following the discussion of background factors, several 
more specific considerations for DSARC presentations are 
discussed. These considerations are derived from DOD Direc- 
tive 5000.1 and include the following: 

| 1. System Need/Program Objectives 
| 2. Performance Parameters 

3. Cost Parameters 

4. System Alternatives 
| 5. Program Plans 

6. Acquisition Strategy 

7. Areas of Major Risk 

8. Special Logistic Problems 

9. Options Available 

Careful consideration and evaluation of the background 
factors and the considerations of DOD Directive 5000.1 will 


provide a project manager with information for the 
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Epuparation of this DSARC presentation. A more detailed 
discussion of these background factors is given in the 
following paragraphs. 

МИЕ PROJECT MANAGER'S APPROACH TO THE DSARC 

PRESENTATION 

The project manager should be the most important single 
source of information regarding his project. However, with 
the wealth of information at his disposal, it is possible 
for the project manager to focus his attention on detail 
during a DSARC presentation and lose sight of the key system 
decision and recommendation to be made. 

ШИЕ initial intent of the DSARC, according to former 
DEPSECDEF Packard, was not to manage programs, but was to 
",. make sure the improved procedures were in fact being 
applied to each major project at all stages and to assure 
that programs were ready to move into production or the ne: 
Stage of development." 

Comparing the considerations of a decision-maker (1) 
problem recognition and formulation, including the specifi- 
Egon of goals, (2) specification of alternative courses of 
action, (3) identification of key uncertainties, (4) collec- 
tion of relevant data, (5) estimation of the value of alter- 


native courses of action, and (6) implementation of the 


š 18 à m Р 
alternative chosen --with Mr. Packard's original intent 


1 
EE evel" Report of Former Deputy Secretary of Defense 


David Packard on Defense Management Problems, 7 August 
8972. 


Ronald E. Frank and Paul E. Green, Quantitative Methods 
we lar keting (Englewood Cliffs, N. J., Prentice-Hall, 
moe, 196/), p.l. 


38 





meee DSARC, it follows that the project manager should 
address in his presentation the question of how the service 
Nas accomplished each of the first five points and how the 
service intends to accomplish implementation, if approved. 
The project manager must provide the DSARC with infor- 
mation regarding his program to show that (1) a requirement 
exists, (2) the best possible procedures have been utilized 
to evalute alternative courses of action and (3) implementa- 
tion has been carefully planned. This will make his presen- 
tation more effective in meeting the goals of the DSARC. 


ШЕРТПЕ EFFECT ON THE PRESENTATION OF THE DSARC 
EDENCIPALS AND THEIR STAFFS 


тле DSARC Principals 

At each DSARC presentation, the management capabili- 
ties of all the DSARC principals are brought together to 
focus their attention on a program decision and to make the 
best possible recommendation to DEPSECDEF. The expertise 
or each of the DSARC principals should be brought into the 
purview of the isl at hand to allow each to effectively 
contribute to the DSARC recommendation. At a DSARC presen- 
tation, the ula] contribution of each of the DSARC 
principals is often overlooked by the project manager. For 
example, at the program initiation DSARC, DSARC I, which is 
research and development oriented and chaired beatis DDR 
and E, system issues which are less development oriented, 


yet which may become significant later in the acquisition 
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ss, are often overlooked. Additionally, preparation 
for production contracting may be overlooked or the plan- 
ning of production options to meet unanticipated budget 
restrictions may not be discussed. 

The project manager should become familiar with 
the expertise and personalities of each of the DSARC prin- 
cipals, anticipate their interest and involvement in the 
decision at hand, and present each one with information to 
enable him to contribute effectively to the decision. Each 
DSARC recommendation is concerned with the total acquisition 
of the system being examined, not just the suboptimization 
of the key system decision at hand. 

ethe Principals’ Staffs 

Гне staffs of the DSARC principals may affect the 
final DSARC recommendation in two ways, (1) by their influ- 
ence on the general attitudes of the DSARC principals and 
NDS the direct effect of their analyses. 

Since the DSARC principals occupy difficult, time- 
consuming ае Anke positions, they often receive informa- 
tion which is either developed directly by their staffs or 
else passes through the staffs. This shaping and filtering 
process and close personal contact over a long period of 
time can affect, understandably, the attitude of the DSARC 
principal with respect to the program, though this effect 
may be less noticeabie than that of the direct analysis. 

Prior to DSARC presentations, the staffs of the 


DSARC principals become deeply involved in a detailed 
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шиши елрасјоп о: the program. During these investigations, 
the staffs develop adversary approaches to key system deci- 
sions to be used by the DSARC principals at the DSARC review. 
This investigation and direct analysis may have a signifi- 
effect on the DSARC principals' final 510 попа > 

The decentralization of defense acquisition manage- 
ment responsibility, emphasized in the Laird-Packard philos- 
ophy, attempted to eliminate to the greatest possible extent, 
interference in program management by OSD except (1) at key 
system decision points, (2) when critical problems arose in 
BEPrams, or (3) as directed by SECDEF or DEPSECDEF. This 
decentralization appears to have allowed the services to 
isolate themselves from C ООО carte: the OSD staffs are 
generally not allowed to "interfere" with the program and 
the service is required only to communicate with the OSD 
staffs in conjunction with DSARC Eus. en During discus 
sions with project managers and OSD personnel, the author 
noticed that there appeared to be hostility toward open 
communication rather than an attitude of harmoniously work- 
ing vara a common goal. 

IMIS lack of open communication acts to the detri- 
ment of good service/OSD understanding and often obscures 


the real issues to be discussed at DSARC reviews. To avoid 


19 


Discussions with Cost Analysis Improvement Group (CAIG), 
Personnel,Office of ASD(COMPT), 8 November 1972. 


И селе" Report of Former Deputy Secretary of Defense, 


Op. elt. P ° 9, 


41 





eee the time of the services and the DSARC principals 
Bro permit timely DSARC recommendations to DEPSECDEF, 
Mimemissues must be clearly understood prior to the DSARC 
review. Informal staff discussions, with a goal of main- 
taining open communication and understanding, without 
interference, could do a great deal to overcome unantici- 
pated obstacles. It is important that the project manager 
utilize the authority vested in him to open the lines of 
communication or to understand the reasons that his 
authority is being restricted and to correct those situa- 


tions. 


Suse AND EFFECT OF THE DEVELOPMENT CONCEPT PAPER (DCP) 
The Development Concept Paper (DCP) is a tool used to 

insure thorough evaluation of a program at service and OSD 

bevels of analysis in that it "...represents a good layout 

of each program as a whole, and enables the DSARC to see 

all factors that should be considered before financial 

resources are heavily committed to it. The DCP serves as 

a sound basis for deciding whether or not we need the system 

and for examining the pros and cons of alternative ways of 


A Phe original intent of the 


approaching the development." 
DCP as stated in DOD Directive 5000.1 was to 
«define program issues, including special logistics 


problems, program objectives, program plans, performance 


ee Admiral Vincent P. de Poix, "Concepts for Improving 


Defense Management" Defense Management Journal, Vol VII, 
EE ] (Spring 1971), p- 38. 
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parameters, areas of major risk, system alternatives and 
acquisition strategy. 


After a key system decision is made, the DCP becomes a form 
contract between the service and OSD relating to the 
future conduct of the program, 

There are proponents within OSD and the services who 
insist that prior to every DSARC, the DCP must be updated, 
reviewed, and fully coordinated through all DSARC principals. 
They argue that complete coordination allows all issues to 
be effectively analyzed. 

The Navy has been criticized for requesting (and receiv- 
ing) DSARC reviews prior to completion and review of a pro- 
Seam s DCP. The Navy argues that prior to the DSARC review, 
resolution of issues is not complete on some programs and 
the "final contract" cannot be consummated. Further, the 
Navy contends that a non-finalized DCP provides the DSARC 
more flexibility regarding its recommendation to DEPSECDEF. 
At the DSARC review new alternatives can be proposed as a 
Eccult of the meaningful interchange between the service 
and the DSARC principals. The changes can be entered in the 
DEP and significant "coordination" time can be saved. 
General guidance within OSD now supports this concept. 

Both sides of the question have valid arguments. In 
programs where many alternatives exist and agreement is 
improbable, the complete coordination of the DCP may not be 
realistic prior to the DSARC review. The final determina- 


tion regarding whether to request the DSARC key system 
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decision review with a complete or incomplete DCP will pro- 
bably be affected by factors such as decisions by seniors 
above the project manager in the chain of command and which 
mre not under his control. Et 15, Nowever, incumbent on 
Цио understand all the reasons for a particular decision, 
to weigh them carefully, and to insure that his program's 


best interests are indeed being served. 


D. A FIRM FOUNDATION TO ARGUE FOR THE PROGRAM 

The basic assumptions and needs on which the program is 
based may be considered by the project manager as accepted 
facts after the first key system decision, DSARC I. This 
belief may be erroneous. The acquisition of a major system 
is a dynamic process. Factors that may be relevant at one 
point in time may be irrelevant at another time. There 
should be DSARC principals or members of their staffs as 
melt as members of the project manager's staff and person: 21 
within the sponsoring service who question basic essumpti 15 
throughout the acquisition of a system. 

i the project manager is to give an effective DSARC 
Meesectitation, he must be prepared to cope with "opposition" 
to his basic assumptions at all times. An example of the 
Ect manager's need to be prepared for DSARC opposition 
curred during a production decision DSARC for the S3A 
carrier-based aircraft program. The project manager assumed 
Enc aircraft carriers would continue to be utilized by the 


Navy during the life of the S3A aircraft. The need for and 
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Memerimnued use of aircraft carriers was questioned at this 
DSARC review. This assumption had not been questioned in 
pre-DSARC discussions by the OSD Systems Analysis personnel 
and the protect manager's lack De Juscitication 
TS he assumption, and thus the ability to settle the issue 
quickly, caused additional DSARC meetings to be held regard- 
ing this fundamental question. Agreement was finally 
reached and only then was the production decision recommenda- 
tion pursued further. 

ime project manager must be able to effectively cope 
With opposition, whether it is directly related to the 
МЕС recommendation at hand or not, if he is to give an 
efficacious DSARC presentation. One method of handling oppo- 
sition that is not directly related to the decision at hand 
is to utilize prepared point papers. Such point papers 
could cover a wide range of topics with current justifica- 
tion and positions clearly outlined and could be utilized 
to "read into the record" the arguments necessary to justify 
assumptions., 
E. THE PROGRAM IN RELATION TO AN ENTIRE MILITARY 

CAPABILITY 

A conflict of interest arises in the formulation of the 
DSARC presentation when the project manager attempts to 
view his project from his advocacy role within the service 
as well as from the level of the OSD. With the complexities 
of system acquisition, the OSD level must be viewed as co- 


Seadinating the acquisition of many systems to provide the 
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mon with a total defense capability. The service project 
Шшишштес, on the other hand, to adequately perform his job, 
must be an advocate for avery small element of that entire 
Sapacility. 

There are too few people in DOD who appreciate the 

problem of getting a total defense program that makes 

se The military and civilian participants in 

this process must learn to take a larger view and 

recognize that the perspective that is appropriate 

eT the project officer is not one that is appropriate 

for someone who is participating in the development of 

the total national defense program. 

To overcome the conflict, the project manager must 
Кај 1г2е, in part, his view. In addition to being a strong 
advocate for his program, the project manager must consider 
ШЕР рторгап іп relation to the entire military capability of 
the nation. This broader view will allow him to relate 
more accurately with the goals of the DSARC and to formulate 
Mes presentation at its level. 

A broader view on the part of the project manager may 
also benefit the service directly. It should allow the 
project manager to develop and suggest trade-offs among 
service programs and service funds. These may benefit the 
Service in the long run. When the broader view on the part 
of the project manager is generalized to include the analysis 


22 
mein C. Enthoven, and K. Wayne Smith, "The Planning, Pro- 


gramming, and Budgeting System in the Department of 
Defense: An Overview from Experience" in R. A. Haveman 
amet. Margolis, eds., Public Expenditures and Policy 
Analysis (Chicago, Markham Publishing Company, 1971), 
me 493. 
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E uterservice alternatives among programs and funds, it 
should enhance his service's position in the competitive 

ф шоврпете of іпгегсегуісе rivalry at the DSARC level. This 
improved position will result because the service will be 

in a position to understand alternatives available to it 
Erding interservice trade-offs апа to utilize those 
options to its own benefit. 

The problem is for the project manager to retain his 
highly motivated advocacy review and at the same time to 
broaden his view of how his system fits into the larger 
national defense scenario. Obviously he can best overcome 
this conflict by being cognizant of national defense objec- 
tives and the part his program plays in meeting those 
objectives. But even more closely related to his advocacy 
status, he must be aware of the programs of his service 
and of other services, how they relate to his program, and 


what trade-offs are available. 
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г. THE BUDGET AND FUNDING PROCESS 

The project manager must be aware of the pervasiveness 
and complexity of the budgeting and funding process because 
this system may have several impacts on his ES 

Budget changes may occur which force immediate changes 
in program plans. To be prepared for potential budget 
changes, a listing of priorities for budget cuts among sub- 
systems Within the program and a means of allocating budget 
cuts among that priority listing must be developed. Such a 
budget change contingency plan will give the project manager 
the necessary information to effectively cope with new alter- 
natives which assume various budget changes if they are con- 
Sidered at a DSARC review. This budget contingency plan 
should be utilized by the project manager as background/ 
support material for his DSARC presentation. 

ШО ада л Ып, the timing of DSARC meetings in relation 
to the budget cycle may have an impact on program alterna- 
mes available. if DSARC reviews are conducted just after 


Program Objective Memoranda (POM) submission and Program 


23 ће system that includes budget planning within DOD was 


conceived by Charles J. Hitch and was introduced into DOD 
in the early 1960's by then Secretary of Defense Robert 
McNamara with the able assistance ‘of Mr. Hitch. It is 
called the Planning, Programming and Budgeting System 
(PPBS) and it provides a multi-faceted system that assists 
in managing DOD resources. An informative, yet brief, 
article regarding PPBS was published in the recent past: 
Бае Charles F., Captain, USN, “The Department of the 
Navy and DOD Planning, Programming and Budgeting System 


(PBS), “ Armed Forces Comptroller, Vol. 17, No. 3 (Summer 
ED Further detail regarding PPBS may be acquired in 


the Department of the Navy Programming Manual. 
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Decision Memoranda (PDM) are issued, each service's budget 
plan for the following year will be somewhat inflexible 
and trade-off alternatives may be largely restricted to 
intra-service trade-offs oum n To overcome the incon- 

E nce of such budget inflexibility, long-range planning 
шау be required to optimize the timing of a DSARC review 
within the budget cycle. 

Overall budget trends may also affect acquisition pro- 
jects. Periods of decreased funding cause austere research 
and development programs which may severely limit the inves- 
tigation of alternatives to meet program objectives. 

The project manages's program may be affected by the 
budget and funding process in many ways such as cuts in fund- 
ing, changes due to program stretchout, the effects of a 
delay in exercising options to buy or unexpected funding in- 
creases. To most capably handle the effects of this process, 
he must possess a thorough understanding of ue? Experience 


in applications of budgeting and funding would also be 


2 ir 
ће previous two references do not address the relationship 


сте DSARC to the annual PPBS cycle; however, an under- 
Standing of the documents mentioned in this paragraph and 
as presented in those references should indicate the rea- 
sons for decreased budget flexibility. 

К ои schools such as the Navy Management Systems Center, 
Monterey, California, and the Defense Weapons System 
Management Center, Fort Bevoir, Virginia, offer courses 
which provide information regarding the budget/funding 
process. 
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highly beneficial and was recommended as a prerequisite 
for the project manager (WSAM) subspecialty an. m. 
END ISTINCT EXTERNAL AND INTERNAL FACTORS 

AFFECTING THE PROGRAM 

A number of indistinct factors affect a program through- 
out its development and acquisition. Due to the pervasive- 
ness of these factors, they may be difficult to recognize 
and deal with. These factors include (1) program visibility 
Киш ехросите; (2) tradition, parochialism, vested interests; 
ED inertia. All may be important in a DSARC analysis 
and recommendation. 

Program Visibility and Exposure 

Program visibility may be regarded as the program's 

EN eptibility, due to its importance, to examination by 
those who may have an impact on it. These individuals may 
include OSD officials, Congressmen, other high government 
officials, the media, and the public as well as those servi e 
Sriticials directly associated with the program. Program 
exposure refers to the method in which a program is pre- 
sented for view by those same groups and may include such 
vehicles as newspaper articles, briefings, congressional 


; . А 2 
testimony, investigative reports and many others. 





26 Ф е Ф 
EIUS information obtained in discussions with Commander 


mas Solan, USN, Office of the Assistant Director for 
Subspecialty Management (WSAM Manager), 9 November 19/72. 


UN particularly good example of high program visibility 
and beneficial exposure regarding the F-15 Aircraft pro- 
curement occurred in a recent article in the Wall Street 
Journal, 12 Feb 1973, p. 3, "McDonnell Douglas's F15 
Fighter Appears Headed for Big Air Force Production Run." 
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High program visibility and derogatory exposure may 
ese grievous difficulty for a system throughout its acqui- 
Поп. It is, therefore, incumbent on the project manager 
e understand the visibility of his program. It is 
important that he monitor, analyze, and guide its exposure 
carefully with constant anticipation of changing attitudes, 
both in favor of and against his program. If overlooked, 
this requirement may produce a negative effect on a DSARC 
presentation and the future of the program. 

2. Tradition, Parochialism, Vested Interests 

Tradition, the handing down or transfer of beliefs 
and customs, may affect a program, particularly in its 
IS formulation, by introducing strengths or by intro- 
ducing weaknesses such as inhibiting new alternatives from 
being synthesized and analyzed. Tradition may introduce a 
weakness into a service recommendation to the DSARC as 
follows. The number of units recommended by the Navy to be 
procured in a shipbuilding program may be large simply be- 
cause tradition E cans that large numbers of ships must 
maintained. Closer scrutiny of this traditional approach 
may indicate that fewer and better, rather than more, ships 
may be cost-effective and benefit the national defense to 
EXrPreater extent. 

Бәншентайташ 165 а restricted or confined interest. 
Parochialism exists, for example, when a submariner believes 
that submarine programs should take precedence over aircraft 


programs, not because they are better, but because he has a 


S 





шештомпе55 of interest. Parochialism may affect the program 
KT proceeds through its initial conception, when basic 
Gee ctives are being established, or through the pre-DSARC 
process when interservice attitudes alter the project mana- 
per's.presentation. Alternatives may be eliminated or basic 
objectives may be altered by parochial interests. 

Vested interests are those interests held by persons 
for their ovn gain. For example, a person prominent in the 
development of an alternative subsystem may promote the use 
of that subsystem, even to the detriment of the major system, 
because his prestige would be increased by use of his sub- 
system. Often change prompted by vested interests leads to 
Modifications to the existing system which (1) require 
m@emer changes in the system, (2) increase the performance 
Capabilities of the system which are not necessary to meet 
objectives, or (3) require contract changes which increase 
costs and change the schedule. All these effects may be 
harmful to the service его 

The effects of tradition, parochialism, and vested 
interests on a program may be similar. Апу weaknesses, 
disagreements, or alternatives introduced during intra- 
service decision-making by either tradition, parochialism, 
or vested interests may force the project manager to 
accept compromise in order to reach agreement among decision- 
makers. Compromise may eliminate alternatives that would 


be more effective in reaching program objectives and adding 
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ШЕРЕсСІІУе іу to the defense posture of the nation. A clear 
Ber standing of program objectives, clear goals which the 
project manager forcefully uses to guide program decision- 
nuns will aid him in overcoming the harmful effects of 
tradition, parochialism and vested interests on his DSARC 
presentation. 

The previous discussion of tradition, parochialism 
and vested interests was intended to focus on situations 
where the three factors would be used within the service 
as "crutches" to provide interservice personnel with argu- 
ments in behalf of their own interests. The intent was not 
wholly to indicate that the effects of these three factors 
were all necessarily deleterious to an acquisitiomn program. 
may all play beneficial roles if used properly. Tradi- 
ton may indicate that obviously cost-effective alternatives 
do not fit into existing Navy organizational systems;j 
changes would be required which would not benefit the Navy 
as a whole.  Parochialism may force a clearer statement of 
program ETC. to overcome its effects.  Vested interests 
may provide substantially increased cost-effectiveness, 
within budget constraints, even though some change may be 
required. The beneficial effects of these three factors 
must also be considered. 

Se Inertia 

Inertia may work to the detriment of satisfactory 

program accomplishment. It may affect a program from the 


service level or the OSD level. 


Eon 





cs e vice Tevel; when program momentum is 
established, it may be difficult to MS when required 
for effective management of the program. This forward in- 
ertia, tends to force the program onward even when realistic 
planning dictates that the program be stopped or that un- 
completed milestones be completed before progress is con- 
tinued. 

At the OSD level, problems discovered in a project 
prior to or during DSARC reviews may cause further progress 
КИ -– delayed. Decreased confidence in the project may 
ect the timely continuance of further work. Investiga- 
meme by the DSARC principals’ staffs may continue or even 
increase, DSARC reviews may be difficult to reschedule, and 
the program may not be allowed to continue temporariiy. This 
type of delay, even though only temporary, imparts a differ- 
гости of inertia on the program, that of a body at rest, 
which may be particulary difficult to overcome, especially 
in a bureaucratic environment. 

Im Che се case, that of forward inertia, when 
ИЕ прјесед milestones are finished but other progress has 
continued, problems may be discovered which call for system 
changes and large quantities of rework in portions of the 
System where progress had been continued. In the latter 
case, a program temporarily halted, total costs may rise 
Significantly due to the normal rate of inflation or due to 
necessary contract changes. Both forms of inertia may have 


Dad effects on a program. 
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A clear understanding of milestone planning and 
its effective application should provide the project manager, 
the service, and the OSD with a guide to overcome inertia as 
follows: "In planning a prcgram--to structure the program 
so that progressive commitments are made only when justified 
by the remaining level of program risk. In managing a pro- 
gram--to assure that the premises on which program commit- 
ments were originally planned T been validated, or 


. Ф . 2 
Even, before additional commitments are made." : 


Н. THE UNKNOWN 

The unknown will be encountered in all programs and the 
project manager must develop a method to deal with іс. One 
important way to prepare for the unknown is to build slack 
into the program ehe With "m pressure for rapid 
Kram completion, this may be difficult for the project 
manager to accomplish, but T is a necessity. Schedule 
slippage will almost certainly occur if there are no pro- 
missions for slack. 

ver, if slack is provided for and is advertised as 
Such in the program ee it may be cut from the program 
by higher authority or used for purposes other than intended. 


Contractors may subconsciously understand that development 


or production schedules may slip. Test and evaluation 


E... jtm ction to Military Program Management, Bogistics 


Logistics Management Institute, Washington, D. C. 
EMI Task 69-28, March 1971, pp. 31-32. 


Nbrd., pp. 34, 73. 
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personnel may provide for testing which cannot be accon- 
KES od Without utilizing scheduled slack. It is part of 
a project manager's responsibility to schedule slack in 
program мПі1е cautiously guarding its presence. 

A project manager may also plan for the unknown by 
developing schedule trade-offs when unknown schedule prob- 
lems are not anticipated. These trade-offs are often 
Seemed "what if" or contingency plans. Intimate acquaint- 
ance with cost, performance, and schedule plans should 
allow the project manager to plan trade-offs that are not 
obvious to all program decision-makers due to their lack 


Eramiliarity with the program. 


CONSIDERATIONS OF DOD DIRECTIVE 5000.1 

As is often the case in staff-prepared documents, the 
requirements of the originator are broad in scope, and 
often the drafters of the directive will attempt to meet 
the originator's desires by encompassing the entire spectr 
Ehe topic. DOD. Directive 5000.1 is such a document. І. 
attempts to provide policy guidance and to address all 
issues of importance in a general manner, Interpretation 
is left, however, to the reader and misunderstanding often 
mestits. 

While the basic understanding of DOD Directive 5000.1 
is important for all project managers, the primary purpose 


Srv tiis subsect@on is to distill, for the project manager, 
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о гипсапепсај сопз1дега јоп5з сопба1пед іп the Directive 
Mat are essential for the project manager to understand 
eor to his presentation to the DSARC. Tailoring the 
ЕКЕ presentation to the issues at hand requires judicious 
preparation and involves interstaff coordination between 
program Sponsor, program coordinator, project manager, and 
WIN so that the interplay between groups will bring out 

the issues of A The considerations to be dis- 
cussed in the following paragraphs should be addressed to 
the degree required by the key system decision being made. 
Nox example, if the recommendation to be made by the DSARC 
regards program initiation, the presentation must address 
the threat in more detail than need be done after the pro- 
gram is approved and production is being considered, because 
proceeding with the program at this decision point will be 
based on whether the program meets a threat to the nation's 
security. At other key system decision points, the threat 
area must also be addressed, but only to the extent of what 
has changed and what has occurred in the analysis of the 
threat that will affect the program. It is emphasized that 
each key system decision will address the following points 
mulated in the DOD Directive but at different levels of 
emphasis. 


30 


Further information regarding the interrelationships of 
the Program Sponsor, the Program Coordinator and the 
Project Manager in the development of the need/objectives 
concepts are discussed in Appendix NB of the Department 


of the Navy Programming Manual. 
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lu. System Need/Program Objectives 


Ihe DSARC is concerned with recommending to the Sec- 
retary of Defense viable defense programs. One of the basic 
Materia it utilizes to make this recommendation is whether 
the program is necessary in terms of what it is intended to 
Mono lish. This accomplishment factor is usually corre- 
lated to the potential enemy threat. The level of threat 
analysis discussed at the DSARC review will ultimately de- 
pend upon the key system decision being made, but more impor- 
tant may be the question of why the DSARC concerns itself 
With the threat. The answer is twofold. One, the Secretary 
of Defense determines policy and therefore desires to ensure 
that defense programs that counter potential threats are 
coordinated to conform Ба that policy; and two, this requires 
ment stops the program manager from adding performance 
characteristics superfluous to countering the threat. The 
project manager knows that T must substantiate every facet 
of his program to the DSARC. This makes the analysis of 
each facet important to the service to (1) ensure that the 
threat is ІЗ ely) countered, (2) ensure that a capability 
is cost-effective and (3) ensure overall management in 
mizing the program's contribution to the national 
defense. 

The discussion of need and objectives is not neces- 
sarily presented by the project manager at the DSARC review. 
Often this aspect of the presentation is presented by the 


OPNAV program coordinator for the Navy or his counterpart 
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(Пе other services from their operational requirements 
E orce structure groups, or other DOD components. For 
example, in a past DSARC review regarding the F5E Inter- 
national Fighter Aircraft both Defense Intelligence Agency 
(DIA) and International Security Affairs (ISA) personnel 
gave ten-minute presentations on need, funds, and commit- 
ENS prior to the Air Force project manager giving his pre- 
sentation. 

Though the project manager may not be directly 
responsible for generating and discussing the need and 
Objectives, he still shares responsibility to continually 
examine and validate the need/requirement as it impacts his 
project management асы сана 

2. Performance Parameters 

The project manager, in establishing performance 
parameters, must realize that he does not possess an open- 
ended budget whereby he can procure whatever the technici ns 
can deliver. There must be a departure from the former j]j z:o- 
cedure of ln uius Peed Git ele nits thimire at the licit 
of Раље O cs The project manager should keep 
performance at the point where the threat is adequately and 


effectively countered and should build into the system room 


31 


The need/objective presentation made at the DSARC review 

is normally classified. Because of this fact, an example 

ot this part of the DSARC is not included in the appendices. 
M raphrased from a speech given by Admiral Elmo Zumwalt, 
Chief of Naval Operations at a Secretary of Defense Manage- 
ment Conference at AIRLIE HOUSE, 29-30 September 1972. 
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ги сште growth only when it is considered cost effective. 
od example of this future thinking occurred in the 
POLARIS weapon system. In the design of this weapon system 
the immediate strategic objective was met, but plans for 
Beemruture indicated that growth capabilities should be 
КИШ itl. The conversion from POLARIS to the improved 
POSEIDON missle did not entail an extreme redesign process 
or high new construction costs because the initial design 
had provided for the planned future growth. 

The DSARC will examine the management expertise of 
the program presented. If the project manager can demon- 
Strate that the performance parameters seiected, and being 
used for design of the system, have been compared to the 
basic objectives necessary to counter the threat, and can 
provide justification that these parameters have been ex- 
panded, only because of the need for growth potential and 


' then this fact should emphasize the 


mee cold plating,' 
positive capabilities of the project's management. 

3. Cost Parameters 

| The program cost estimates discussed at a DSARC 
review may be considered from several aspects; portion of 
Program life considered, items actually included in cost 
estimates, potential changes in costs utilizing alternative 
Systems, reliability of estimates, escalation factors, or 
degree of risk. Generally, the costs addressed at a DSARC 


review should include, as a minimum, each of the categories 


detailed belov. 
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an Acquisition Cost 

dne acguisition cost is the cost to develop and 
Mmeoauce the system. The items included in the acquisition 
СОБЕ estimate should be clearly understood within the service 
ашу Спе DSARC. Often significant portions of this cost, 
for example spare parts Support, are not reflected in the 
Imate to portray a more favorable situation than actually 
exists. 

During the early stages of development, acquisi- 
cost may be particularly difficult to estimate. During 
early development, only parametric cost estimates may be 
available. During later development, detailed engineering 
estimates and production cost data may be developed to fur- 
Smee refine original estimates. 

The basis for PI cost estimating is that 
costs of a defense system are related in an approximate but 
quantifiable way to their physical and performance character- 
со through past experience.and data with similar items. 
Advantages of crue estimates include: (1) they may be 
calculated quickly; (2) they may be inexpensive; (3) they 
should Ма reflect typical progran problems; and 
(4) they may be utilized early in the program. Disadvantages 
May include: (1) they re an extensive and correct cost 


and performance data base (not one based on mismanaged 


report to the Congress, Acquisition of Major Weapons Sys- 
Ko Бу пе Comptroller General of the United States, 
Meenas. 1971, pp. 72-73 and March 29, 1972 (Draft copy) 
pp. 101. 
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programs; (2) relationships between cost, physical charac- 
Bemmestics, and performance must continue to exist and to 
Пи ла in their extrapolation; and (3) extrapolations 
involving state-of-the-art developments may be erroneous. 

Detailed engineering cost estimates also have 
advantages and disadvantages. The primary advantage is 
that they may be more accurate than parametric estimates 
due to their significant, in-depth analysis. The disadvan- 
tages are: (1) they may be costly due to the large man-hour 
'requirements for experienced estimators; (2) they take sig- 
nificant time to develop; (3) they may not reflect potential 
problems or changes in the program; and (4) they may only 
be available late in T development stages of the program. 

Differences between actual acquisition costs 
incurred, their original estimates, and, most important, 
expected costs to completion should be anticipated and 
explained at DSARC reviews. 

b. Life Cycle Cost 

Life cycle cost is defined as the total cost for 
the а ее, вачы еа соп, opération, andilogistic sup- 
port of a system over a defined life span. All support 
costs should be considered in life cycle costs and discount- 
ime, inflation and "trade-in" or residual ИЕ е Б 
should be applied. 


опата W. Srull, “Parametric Cost Estimating Aids DOD in 


Systems Acquisition Decision," Defense Management Journal, 
ОНО. 1, (іргі1! 1972), рр. 2-5. 
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ШЕЕЕ саве cost (estimates are important to the 
project manager since they may be used in cost-effectiveness 
Bes related to his program, in requirement studies where 
Ethan one system is being considered, as a part of his 
DCP, and in efforts such as concept formulation and contract 


definition (cr/cp) .?? 


ЕП) Design Со" peo a 

Though 'design to' costing has been used for some 
дише in commercial product development, its application to 
military systems development has been fairly recent. The 
objective of 'design to' costing is to develop and produce 
 бЕсп within a predetermined cost constraint; that is, to 
use cost as a design parameter. 

The basic requirements for a ‘design to’ cost 
target system are first, to have a good original estimate 
GE the cost to produce and, secondly, to have a feedback 
system capable of initiating corrective action when the 
"design to' threshold may be breeched. Though the benefits 
Ж design to' costing include increased visibility of the 
cost А produce and better identification of future value 
engineering change proposal opportunities resulting from 
@est feedback, the primary benefit is that it provides a 


System to track cost-to-produce to allow initiation of 


Жи Department of the Navy Programming Manual, Appendix J. 
Vice Admiral Eli T. Reich, "The Challenge of Cost-to- 


Produce," Defense Management Journal, Vol 8, No. l 
ШІРгІ! 19/2), pp. 6-10. 


36 
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Memeo priate corrective design action early and in and 
throughout the development cycle. 
ume application Of ‘design to' cositing as (1) 
a tool of system acquisition and (2) to provide better 
program management should be stressed and the benefits it 
ШЕ ртоуійеа4 should be delineated, if applicable, at the 
DSARC review. 
4. System Alternatives 
"In choosing from among alternatives, the best alter- 

native will be that which contributes most effectively and 
efficiently to the attainment of a desired ML A point 
to be emphasized in the presentation of alternatives to the 
DSARC is that the program has flexibility. Both the manage- 
ment as well as the technical capabilities of the system 
are being assessed by the DSARC. The project manager must 
demonstrate firm control of the program. Alternatives 
developed must consider future service environments in which 
systems will operate and the presentation must indicate a 
plan for continual updating. 

| There will be times when the stage of acquisition 
will dictate the number of alternatives available. For 
some programs the only acceptable alternative may be the one 
that cancels the program. Whatever the situation, the impor- 


tant concept to emphasize is the capability to circumvent 





role weon mand Cyril O Donnell, Principles of Manage- 


Ment: An Analysis of Managerial Functions (New York, 
McGraw-Hill Book Company, 1968), p. 223. 
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Emcertainty and to have a clear path toward program objec- 
fives. If a program has progressed to a position where the 
Only alternative is to cancel, then this situation must be 
made known to the DSARC so that they are cognizant of the 
circumstances surrounding their recommendation. 

с ппшрет ог: Screws to be designed into the Patrol 
Frigate is an example of a system alternative discussed in 
Appendix E, pages 143 through 144. 

wee Program Plans 
a. The Milestone Approach 
The recommendation made to the Secretary of 
Defense on whether to continue with a program is partly 
шоа on the program manager's ability to show that mana- 
gerial control of the program is sound. This is best demon- 
strated by establishing firm goals and then meeting them. 
This concept is called "EI > Established goals 
must relate to key, observable, and measurable events and, 
most important, must be able to indicate accomplishment of 
the key event. When the milestone is accomplished, the 
risk соста а with the program has been reduced by an 
observable amount and the chances of successful completion 
of later milestones within the assigned thresholds of cost, 
schedule and performance have been improved. 
Milestoning will also provide the program 


Manager with control over concurrency. Concurrency, in the 


E troduction to Military Program Management, op. Gita; 
Dp. 25-33. 
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Bet sense, is the overlapping of major phases of a pro- 
ЕШ; е.с., Starting the production phase prior to finish- 
ing the development phase. There are situations where some 
type of concurrency is necessary or desirable, such as in 
the procurement of long lead-time items. Milestoning, be- 
cause of its finite measurement capability, should provide 
the program manager with a check point with which he may 
derive information necessary to make proper decisions. 

Demonstrable accomplishments are the most effec- 
tive indication of program progress. For the project manager 
milestones divide the total procurement into smalier portions 
for which individual plans may be developed; emphasizing the 
accomplishment of milestones will furnish the DSARC with the 
information it needs to make its recommendation regarding 
the future of the program. 

b. Test and Evaluation 

The Test and Evaluation Plan is one of the items 
mete is used to provide the explicit measurement necessary 
for demonstrating К сс of milestones. 

There are two types of test and evaluation, one 
type NE ага with the development of the system and the 
second associated with the operation of the system. Test 
and evaluation must be drafted into the program when develop- 
ment of the system is undertaken and must be continuous 
throughout the program. Test and evaluation should provide 


(1) information regarding development, i.e., development 
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testing useful in resolving problems to meet development 
ес уез; (2) information for acquisition milestone 
(5105, the best information available on completion of 
milestones required for a key system decision, and (3) in- 
Formation for effective system operational test and evalua- 
Езоп Не.“ 

Test and Evaluation has always been an important 
facet of systems acquisition but increased emphasis on this 
essential operation has placed it in a position such that 
the program manager must be able to discuss test and evalua- 
tion explicitly at each DSARC аа м The importance of 
addressing test and evaluation is emphasized by the require- 
ment for the project manager to "m prior to the 
Eua] DSARC, a copy o£ his overall test and evaluation 
ФП (о the Deputy DDR&E (Test and Evaluation) for analysis. 

Appendix L, pages 128 and 129 Provides an 
example of an outline of a test and evaluation plan. 
Appendix E also provides a good discussion of this topic. 

Acquisition Strategy 
Acquisition strategy, as viewed by the authors, is 
that CETT related to the procurement or the "buying" of 
the system. The document which relates directly to the 


Mailed "buying" strategy of a system is the Advanced Pro- 


curement Plan (APP). This Plan may include the overall 
39 


Department of the Navy R D T & E Management Guide, 
Ор. Cult. Р. 7-8. 


Mee Report of the Blue Ribbon Defense Panel of July 1970. 
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System or may be made-up of several subsystem plans. The 
continued updating and use of the APP as a management tool 
Should overcome many of the difficulties of coordinating 
E rective acquisition strategy. 
Mmes related to acquisition strategy, as they 

EY to the DSARC review, follow. 
ЕШ Source Selection Beau at ona 

The complexities of source selection dictate 
Beate evaluation criteria be formulated early and continue 
шире developed over a long period of time. 

The DSARC does not normally become involved 
Geeeectly in source selection although the DEPSECDEF or 
SECDEF may be. However, for a more complete understanding 
Buche program, the DSARC is interested in information 
comparing the programs of unsuccessful bidders with the 
winning proposal, particularly comparisons of cost, schedule 
and performance characteristics or other pertinent informa 
ern." 

b. Gem stets Type 
Though it is not intended that the project mana- 


ger become a contracting officer, the greater his knowledge 


of contracting, the more analytical and knowledgeable can 


An informative article regarding source selection evalua- 


Топ was contained in the Defense Industry Bulletin dated 


August 1969 and was entitled "Contractor Proposal Evalua- 
tion Process Defined by AMC." The article was written by 
Victor Garvis. 


2 | — 
Memorandum for Secretaries of the Military Departments 


dated 26 June 1970 from DDR & E (Subject: DSARC Reviews 
Containing Scurce Selection Information Briefing). 
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ENS approach to contracting at the DSARC review. The 
Beet manager should be cognizant of and understand all 
EuBrPact types and their applicability or lack of applica- 
ПИШУ to his program. 
с. Maintaining Competition 

Maintaining competition during development and 
МЕО LO production can provide significant benefits for a 
program. This method of decreasing risk during development 
and cost of production does, however, present problems. 
In many programs parallel development costs are prohibitive 
because of the size and scope of the development; in others 
sole source production contracts may be required. A thor- 
ough analysis of trade-offs between maintaining competi- 
tion and cost limitations must be accomplished at all key 
System decision points to ensure maximum efficiency within 
budget constraints. 

d. Management Information 

The procurement of management information may not 
Eur to be a significant part of the acquisition strategy, 
Mate in the past great problems have arisen regarding it. 
Excessive requirements were forced upon contractors, worth- 
less information was reported and funds were wasted. 

Because of previous difficulty, the acquisition 
of management has received much attention and the Cost / 
Schedule Control System Criteria (C/SCSC) were developed to 


Temp rectify this problem. C/SCSC aids the project manager 
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шаша іт упр management information from which uniform cost, 
memeaule and performance information for meaningful appli- 
cation to decision-making at the service and OSD levels may 


. 43 
be extracted. 


Areas of Major Risk 

The DSARC is vitally interested in the areas of risk 
which endanger program completion or may cause breeches of 
Seems schedule and/or performance thresholds. To satisfy 
Mitsminterest, the DSARC must be (1) appraised of the alter- 
natives and trade-offs available to reduce risk and (2) 
presented with an evaluation of the degree of risk and the 
probability of overcoming the risks successfully. The tools 
the project manager should use in the evaluation of risk for 
final presentation to the DSARC are:risk management, risk 
assessment, and risk analysis. 

Risk management is the generation of alternative 
courses of action for reducing risk and should be considered 
when system alternatives are presented. Risk assessment is 
a comprehensive, and frequently structured, process for esti- 
Кол, Mace risk associated with a particular alternative 


course of action. It is often handled by systems analysis 





43 


DOD Directive 7000.2 (Subject: Performance Measurement for 
Selected Acquisitions) delineates policy regarding the pro- 
curement of management information. 


E -ther information including broad coverage of risk hand- 
Шипр may be obtained in the Final Report of the USAF 
Academy Risk Analysis Study Team, Colorado, l August 1971. 
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poonnel. It provides information regarding the degree of 
idence in a specific alternative. Risk analysis is 

m erfort of coordinating risk assessment and risk manage- 
ment in an iterative cycle to develop the most feasible, 
least risk alternatives for program accomplishment. 

There is much subjectivity involved in risk assess- 
ment. However, the primary benefit of risk assessment is 
ET the problem is attacked in an orderly, consistent 
manner. This orderly method of solving the risk problem 
can produce positive results, an increase in the project 
Mas er's confidence in preparing for a DSARC and more 
Eu rtaptly, it can produce increased confidence by the 
DSARC іп the project manager's management of his project. 

A good example of a discussion of risk is contained 
in Appendix E, page 146. 

EE Special Logistic Problems 

tegrated logistic support is a complex disciplin 
which can provide substantial benefits for the program or 
Can create grave problems for the project manager. Proper 
planning to insure adequate logistic support without com- 
Meeting resources too early, i.e., logistic support in phase 
with program accomplishments, must be the goal within each 
project. 

Integrated logistic support planning concepts must 
be developed early in the program to ensure that all logistic 


elements required to support the operational system are 
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Meeperly planned, developed and coordinated with the system 
design. 

Tice y o] of ILS Planning and development activity 
during the acquisition process must be consistent with the 
meds Of each phase of the acquisition process. For example, 
during advanced development broad ILS planning must be 
accomplished while engineering development ILS plans must be 
further refined in such areas as maintenance planning, 
mop stic support personnel, technical logistic data and 
information, support equipment, spares and repair parts, 
eei lities and contract НПС As the acquisition 
process proceeds toward production, plans become more de- 
tailed and address specific milestones and problem areas. 

The project manager must be able to discuss each 
Eel Of the ILS plan; however, detail should be tempered 
Wee favor of the integration of the ILS plan into overall 
program plans. Appendix D, pages 134 through 135 provides 
BuU outline for such a discussion. Appendix E also addresses 
this concept on page 146. 

9. Options Available 

The DSARC presentation should clearly enumerate the 
options available to the DSARC and DEPSECDEF. Tt is at this 
point that the project manager has an opportunity to express 
mese are the elements of integrated logistic support as 
suggested in notes prepared for the UCLA Short Course, 


Integrated Logistic Support, by Dr. Melvin B. Kline, 
September 1970. 
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his services’ analysis regarding what recommendation the 
DSARC should make. As the person closest to the program, 
the project manager's recommendation should be influential. 
However, the project manager's recommendation cannot be 
Mmeamocnial. The options presented by him should normally 
include: (1) progress as recommended toward program con- 
pletion, (2) choose from one of several options for more 
cautious progress toward program completion, such as one 
EM -cveral proposed partial production buys rather than 
MEF] buy, or (3) cancel the program. The DSARC presen- 
tation should indicate which option the service considers 
oO Se the best alternative. 

Appendix D, pages 104 Git ОНА и р, pastor ae Sama a 
cit example of the options presented in the PHALANX 


CIWS DSARC presentation. 
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V. PROPOSED GUIDE FOR PREPARATION OF THE DSARC PRESENTATION 


IT Previous chapters, the consideration for a DSARC 
ee entation and the existing methods of preparation were 
discussed. To improve upon exísting check-lists for DSARC 
preparation, a guide has been prepared to assist in prepara” 
tion for key system decision DSARC presentations. For pur- 
poses of cross reference, the topics in the guide are in 
EE Same order in which they occurred in Chapter IV. 

It is mot the intent of the proposed guide to provide 
a "cook-book" method for the preparation of the presenta- 
Mon, Rather, the intent is to provide a general and 
flexible guide which considers all factors pertinent to 
the presentation with emphasis on the non-technical factors. 
ШИЕ project manager must provide his emphasis, as necessary, 
on various portions of the proposed guide depending upon 
the key system decision to be made or special issues to 1: 
essed as Ec by the DSARC principals or his 
service. 

PROPOSED GUIDE FOR PREPARATION OF THE DSARC 

PRESENTATION 
Pee APPROACH TO THE DSARC PRESENTATION 

The project manager's approach to the DSARC presenta- 
tion must include information related to the following: 


1. problem recognition and formulation, including 
specification of goals and thresholds; 
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2 Ptecmiitcation of alternative courses of action: 
identification of key uncertainties; 
4, means of collection of relevant data; 


5 estimation of the value of alternative courses of 
action: 


6. description of the means of implementation of the 
alternative chosen. 
fons DSARC PRINCIPALS AND THEIR STAFFS 
ere effect of the DSARC principals and their staffs 
should be considered and every effort should be made to 
understand their motives, interests, and capabilities and 
to provide them meaningful information on which they may 
make effective recommendations. 

1. Are the interests, personalities, and expertise 
of each of the DSARC principals thoroughly under- 
stood? 

2. Is the area of management interest of each of the 
DSARC principals to be addressed in the DSARC pre- 
sentation? 

3. Have open communications been maintained with the 
OSD staffs to insure that the real issues are 
clearly understood prior to the DSARC presenta- 
tion? Have specific issues to be addressed at 
this presentation been promulgated by the princi- 
pals' staffs? 

4. What specific disagreements between the service 
and the principals Or their staffs are known; who 
are the persons involved and how will the disagree- 
ments be settled? 

ШЕН ТНЕ DEVELOPMENT CONCEPT PAPER 
The Development Concept Paper (DCP) plays an important 


part in the DSARC presentation although its intended use 


may vary. 
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Should the DCP be completed by the service, re- 
viewed, and coordinated by the DSARC principals 
Бек to the DSARC? 


Will the attitudes of the DSARC principals be 
versely affected by lack of a coordinated DCP? 


пе completed DCP will not be reviewed by the 
DSARC principals, what is the specific reason? 
ME ENIS reason really in the best interests of 
the program? 


р. A FIRM FOUNDATION TO ARGUE FOR THE PROGRAM 


several assumptions may have been made regarding the 


key system decision at hand. All the assumptions do not 


carry the same importance, but several could interfere 


Lan effective DSARC presentation. A firm foundation 


шшатрџе for the program must be available. 


HI 


What are the assumptions on which the presentation 
is based? 


Mes the assumptions or other items not directly 
related to the decision at hand are questioned, 
how will the questions be answered satisíactorily 
when the project manager does not have the answers 
wi his mind; point papers, assistance of the pro- 
gram coordinator, answered at a later time? 


RELATIONSHIP TO ENTIRE MILITARY CAPABILITY 


Each program must be viewed as an element contributing 


to the 


>. 


entire military capability of the nation. 


Is the project manager aware of bread service and 
DOD objectives regarding the militarv capability 
oi the nation and how his program contributes to 
those objectives? 


What other programs are trying to meet basically 
the same objectives? 


Are intraservice or interservice trade-offs avail- 


able to enhance the nation's military capability 
and to also benefit the program? 
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F. THE BUDGET AND FUNDING PROCESS 


The budget and funding process pervades the acquisi- 


tion of defense systems. Not only the handling of program 


funds, 


but the broader aspects of the budgeting process 


May effect the program. 


l. 


Does the project manager understand the broader 
aspects of the budget and funding process as well 
as his own management of funds? 


What are the effects of the budget preparation 
sequence on the program schedule and DSARC pre- 
sentation? 

Has a "budget change plan" been prepared to 
establish a priority of subsystems to accept 
budget changes and provide an allocation of budget 
euampes of the priority listing of sybsystem? 


END ISTINCT INTERNAL AND EXTERNAL FACTORS 


Several somewhat indistinct internal and external fac- 


ors, 


of which the project manager should be aware, may 


affect the program. 


ш, 


How visible is the program in relation to other 
programs? Is this likely to change in the future? 


Can those who are interested in the program aid 
or adversely affect the program because of its 
vers Бат ву? 


To what type of exposure has the program been sub- 
jected? Must increased or decreased control of 
exposure be exercised? 


Dime trad@tion play a part in early program deci- 
СПО П tradition affect the program at the 
OSD level when interservice competition is 
involved? 


Diss rochialism play a part ¿in early programéde- 


cisions or does it influence present decisions? 
Doeomtihis weaken the program by forcing compromise? 
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Have vested interests introduced excess perforn- 
Eucecand excess cost into the program? Can the 
excesses be removed to improve the program? 


клешта стоп, parochialism or vested interests 
decreased the alternatives available to the pro- 
gram? 


Has good milestone planning been accomplished to 
overcome the effects of inertia? 


ШЕ гогуата inertia causing the program to continue 
to progress when good management practice dictates 
that milestones be completed before progress con- 
tinued? 


THE UNKNOWN 


The unknown will be encountered during the program. 


Methods of dealing with it are necessary; however, they 


may have low visibility. 


1. 


Js slack available within the schedule to compen- 
sate for unknown problems? What is being done 

to insure that planned slack is not used when not 
necessary or unrealistically cut from the program? 


Holt funding be planned to compensate for the 
unknown? Who knows and who should know exactly 
what the program budget is? 


Unat alternatives/trade-offs are available through- 
out the program when technical difficulties arise? 


CONSIDERATIONS OF DOD DIRECTIVS 5000.1 


3 


System Need/Program Objectives 


The system need and program objectives will be 


mescussed specifically at DSARC I, but the DSARC's that 


follow will also reevaluate these. 


a. Who has defined the threat and is it agreed 
upon within vVarioûs intelligence gathering 
agencies and the services? 
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5. Do the program objectives meet the current 
Enreat? Are there further considerations such 
as future development potential of the system? 


С Мау the threat change in the foreseeable 
future and what changes might be made in the 
program objectives to make them more adequately 
meet the threat? 


Performance Parameters 


Performance parameters may require change during 


sitema development, but change frequently adds cost and 


lengthens schedule to completion. 


a. Were performance parameters established based 
on the threat? 


b. Is all available technology being utilized? 
Are we pushing the state-of-the-art? What is 
the technical risk? 


с. What performance envelope is acceptable to 
insure that program objectives are attained? 
What are maximum and minimum performance para- 
meters and what are present expectations? 


d. Have performance parameters and costs been 
Sons ldercdtogether to provide cost-effective 
performance? 


Cost Parameters 


A clear understanding of exactly what costs are 


being addressed will assist the DSARC in making effective 


recommendations. Often cost information is incomplete and 


optimization of combinations of systems does not occur; 


the total national defense is jeopardized. 


a. Is the estimate of acquisition cost a point 
estimate or a range of cost and what is the con- 
fidence in the estimate? 


b. Who made the estimate; how was it made (para- 


metric cost estimate, engineering estimate) and 
against what was it checked? 
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4. 


soms. 


С (Пәк is the estimate of life-cycle cost? How 
was it estimated and by whom? 


а. Has a ‘design to' cost been established? How 


Go present estimates compare with the required 
cost target? 


System Alternatives 


System alternatives may be developed for many rea- 


Mu may reduce technical uncertainty, help to pro- 


Sa lower cost system, and provide program flexibility 


momovercome budget changes. 


>. 


system, 


a. What system and subsystem alternatives are 
presently available? 


b. What is the cost-effectiveness of the major 
alternatives and how do they compare with the 


program objectives? 


c. Why are additional alternatives still being 
considered? 


d. Do we need to generate mew alternatives? 
Program Plans 
In addition to the strategy involved in buying the 


the use of milestones in the program plan and the 


test and evaluation plan are important facets of the over- 


all program plan. 


a. What are the major milestones of the program? 
Why have they been established? 


b. Will concurrency exist, be reduced or be 
eliminated in the program with the present mile- 


stones? 


с. What milestones are to be accomplished prior 
to the next DSARC? 


d. Has a test and evaluation plan been prepared 
and submitted to the Deputy DDR & E(T & E)? 
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6. 


е. What testing milestones must be accomplished 
PC roro the next DSARC? 


ilo what extent will the "fly before buy" con- 
eepe be realized in this program? 


Acquisition strategy 


nema dvanced planning of the acquisition strategy 


particularly important since long periods of time may 


ИЕ: гес to execute various portions of the plan; e.g., 


Se selection evaluation. 


a. Has the Advanced Procurement Plan (APP) been 
completed and approved by the service for the 
key system decision under consideration? 


Б^, Have the criteria for source Selection evalua- 
tion been developed? 


с. What differences were noted between the pre- 
Hcrred proposal and the unsuccessful bidders' 
proposal? 


а. Why was the contract type selected? What 
advantages does it offer for the government and 
(те сопетасеког? 


е. How vill fúutuüure contracts be structured 


f. How is competition being maintained in this 
procurement? What are the trade-offs between 
maintaining competition and increased development 
costs/decreased production costs? 


g. Are the principles of the Cost/Schedule Con- 
trol System Criteria (DOD Directive 7000.2) appli- 
cable to this procurement? If so, how are they 
being applied? 


Teas of Major Risk 


The major risks noted in the acquisition of the 


system may be best managed by assessment, risk management, 


asi analysis. The DSARC is vitally interested in the 


areas of major risk and how they are being overcome. 
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8. 


аецца are спе агеа5 of major risk in the program? 
How were they determined? What are the probabili- 
mires Of Overcoming them? 


D How have alternatives been structured to over- 
come risk? 


Special Logistic Problems 


lumeeserated logistic support (ILS) has become a 


Eorpnussticated discipline for application to system procure- 


ment. 


The DSARC is particularly interested in logistic 


elements which remain problems and which require special 


emphasis. 


9. 


а. Have all the elements of logistics been included 
im the ILS plan? If not, how are those not in- 
cluded being handled? 


Б. What logistic problems exist and what is the 
plan to correct the problems? 


Options Available 


The DSARC must be appraised of specifically what 


options the service considers as presentiy available for 


the DEPSECDEF and which the service recommends. These 


options will normally include: 


ЧК Continue the program via the alternative plan 
recommended by the service; 


b. Continue the program via alternative plans such 
as: cut/imcrease quantities; delay schedule; 
change performance parameters; 

c. Do not continue with further work, but gather 
Jure" iniormation to support continúance of the 


program; 


d. Discontinue the program. 
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VI. CONCLUSION 


M Mthesis prowides the project manager with a set of 
guidelines which can be used to better prepare his presenta- 
NOn for the DSARC review. 

ШЕШ 515 of the current procedures used by the services 
ted to a conclusion which supports the concept of the pre- 
DSARC review. This pre-DSARC review is considered very 
important to the development and refinement of the issues 
concern to the DSARC. A beneficial effect of this pre- 
Brew is that in addition to the presentation of issues 
called out іп рор 5000.1 being refined, the less tangible 
aspects to be considered are also emphasized. This pre- 
review effort enables the project manager to focus his 
presentation on those items of primary interest to the 
DSARC. 

Checklists, as developed by the Army and the Aur Force 
are judged as an ET р fisting of many orf гпесатрарт- 
Technical criteria of which the project manager should 
be aware in is his program. However, it is felt 
that these checklists do not provide the project manager 
meen broad enough guidance to completely prepare for a 
DSARC presentation. 

The considerations discussed in Chapter IV are what 
the authors compiled from their analysis of interviews with 


DOD personnel, study of service procedures and documentation, 
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and the study of checklists. А firm knowledge of these 
Pomsiaerations is believed to be necessary for the project 
manager as a base for his DSARC presentation. Together 
with the pre-DSARC review, these considerations will 

Бе the project manager to effectively, impressively, 
and knowledgeably address the DSARC. 

Тп Chapter V the authors have summarized their considera- 
tions for the project manager and presented them in synoptic 
form for ease of use by the project manager. The authors 
believe that because of the broad nature of their proposed 
guideline information, emphasizing the non-technical aspects 
of the DSARC presentation, it may most effectively be pro- 
mulgated informally as a general guide to be used by project 
Magers of all services in conjunction with other tools 


the preparation of a DSARC presentation. 
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APPENDIX A 


Toe DEPUTY SECRETARY OF DEFENSE 
Washington, Do C. 20301 


30 Мау 1969 
(Сору) 


MEMORANDUM FOR SECRETARIES OF THE MILITARY DEPARTMENTS 

DIRECTOR, DEFENSE RESEARCH AND ENGINEERING 

ASSISTANT SECRETARY OF DEFENSE 
(COMPTROLLER) 

ASSISTANT SECRETARY OF DEFENSE 
INSTALLATIONS AND LOGISTICS) 

ASSISTANT SECRETARY OF DEFENSE 
(SYSTEMS ANALYSIS) 


ЖШИБТЕСТ: Establishment of a Defense Systems 
Deqwasirion Review Council 


І Пауе been reviewing for some time current practices within 
the Department of Defense for the acquisition of major sys- 
ES" My review has highlighted the importance of our 
organization and practices for accomplishing this management 
ND The primary responsibility for the acquisition and 
management of our major systems must rest with the individual 
Services. Within each Service, this responsibility is 
focused in the Project Manager. Recognizing the Service 
responsibility, I am, at the same time, most anxious of in- 
NE, before we approve transitioning through the critical 
milestones of the acquisition of a major system, that all 
facets of the acquisition process are properly considered. 


Toward this end, I am establishing a Defense Systems Acquisi- 
tion Review Council (DSARC) within the Office, Secretary of 
Defense, to advise me of the status and readiness of each 
major system to proceed to the next phase of effort in its 
ШЕГЕ cycle. The Council vill serve to complement the 
Development Concept Paper (DCP) system, which continues as 

a formal DOD management and decision-making system for the 
Mmea@uisition of major systems. The Council will evaluate 

the status of each candidate system at three basic milestone 
Memes: First, when the sponsoring Service desires to 

ME iate Contract Definition (or equivalent effort); second, 
Но it is desired to go from Contract Definition to full 
Sale development; and third, when it is desired to transi- 
tion from development to production for Service deployment. 


The functions of the Council are separate from and do not 


encompass the management reviews of major systems which I 
have previously requested and which are being conducted by 
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DBR&E with assistance from ASD(I&L) and ASD(Compt). These 
reviews are focused on the management of the system whereas 
BIZDSARC reviews will cover all issues, program thresholds 
Mother matters normally treated in DCP's. Also, the 
management reviews will normally be held only once on each 
major system; whereas the DSARC reviews, which are based 

On program milestones, will ba normally conducted three or 
e times during the acquisition cycle of a particular 
system. 


ШИЕ шепбретсһір of the Council will include DDR&E, ASD(I&L), 
Ecc). and ASD(SA). For the first two milestone reviews, 
15, prior to entry into contract definition and prior 
шп ту into full scale development, the Council will be 
chaired by the DDR&E. For the third review, related to 
mmemtransition from development to production, the Council 
will be chaired by the ASD(ISL). 


mM initially defining major systems, which will be subject 
HN council reviews, to include (1) those for which Develop- 
ment Concept Papers are required; and (2) those specifically 
designated by me for review and evaluation. А tentative 
Charter for the Council is attached as an enclosure. I 
Eure that the DDR&E and ASD(I&L), vithin the next 30 days 
jointly prepare the necessary procedures and take the 
necessary administrative actions to implement the Council 
charter. 


NN lieve the Council operation vill result in improved 
management and will augment the decision-making process 
within the Department of Defense. I cannot over-emphasi 2 
the need for complete interface throughout the Departmen 
in the system acquisition process. 


/s/ DAVID PACKARD 


Enclosure 
a/s 
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1. 


Charter 


Defense Systems Деси БОЕ боп Review Council 
ii pose 


meee charter prescribes the mission, functions, composi- 
Bern, authority and responsibility, and administration 
of the Defense Systems Acquisition Review Council 
(DSARG). 


Mission 


The mission of the DSARC is to review major and impor- 
tant Department of Defense system acquisition programs 
at appropriate milestone points in their life cycle. 
These reviews are intended to permit coordinated evalua- 
tion and deliberation among senior managers, based on 
the most complete presentation of information available 
to assure that advice given the Secretary of Defense is 
as complete and objective as possible prior to a deci- 
On to proceed to the next step of the system's life 
cycle. The DSARC operation and evaluations will serve 
to complement the DCP system which remains as a formal 
DOD management and decision-making system concerning 
the acquisition process of major defense systems. 


Functions 


a. The DSARC will review and evaluate the status of 
each appropriate system acquisition program at three 
basic milestone points: 


First: yhen initiation of Contract Definition (or 
equivalent effort) is proposed; 


Selina: When transition from the Contract Defini- 
tion phase to full-scale development is 
proposed; and 


Third: When transition from the development phase 
iato production for Service deployment is 
proposed. 


b. The first review will support the basic DCP in that 
it will provide a forum for discussion and possible 
resolution ofthe various viewpoints of the parti- 
cipating principals, including the Secretary of the 
Military Service sponsoring the program. The later 
reni evs will cerve a function of validating the 
readiness of a system to proceed to the next stage, 


i.e., normally full-scale development or production. 
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B. Composition 


ІНЕ DSARC will consist of the DDR&E, the ASD(I&L), the 
p (Comptroller) and the ASD(SA). 


D. Authority and Responsibilities 


EM Or consideration of entry into Contract Definition 
Contract Definition Phase) and entry into full- 
scale development (the full-scale development phase), 
the DSARC will be chaired by the DDRSE. 


D Por the transition from development to production 
Gave production phase), the DSARC will be chaired 
bv the ASD(ISL). 


EN Lor additional reviews, the DSARC will be chaired 
Bye DDRG&E or the ASD(ISL) as appropriate, depending 
Әп whether the action under consideration is con- 
cerned with movement within the full-scale develop- 
Шош pl ase oz into or within the production phase. 


Reviews at points other than program transition 
points may be requested by a DSARC member by 
memorandum to the appropriate chairman. 


EN еч of a program at any point in its life cycle 
may be directed by the Secretary of Defense or the 
Deputy Secretary of Defense. 


f. Reviews will be limited to major and important pro- 
grams, These are (1) those for which Development 
Concept Papers are required; and (2) those speci- 
fically designated for revi@w by the Secretary of 
Defense, the Deputy Secretary of Defense or the 
appropriate DSARC chairman. 


°’ среске to be considered by the DSARC include, but 
are ПОС limited to, the following: 


МО ког items proposed for Contract Definition 
(a) Justification of militaryemeed; 


(Б)  Valddity of operational concept and 
objectives; 


(c) Relative capability compared with present/ 
више равед апа with capabilities of other 


systems; 


(d) Technical feasibility; 


88 





(e) Validity of cost estimates and analysis 
Of COSTE ricks involved: 


(£f) Validity of proposed scheduling and con- 
sideration of altëérnatives thereto: 


(2) Validity of proposed procurement methodo- 
Шору, including type of contractor 
SETUCTUrE ki kind otifcontract imi t Co 
Government production commitment, means 
of assuring competition; and 


(h) Validity of program manager plans, con- 
Ero ls and organization. 


ша Бок items proposed for transition from Contract 
Det Рот into full- scale development: 


D Continued validity of program objectives 
and validity of changes thereto since 
completion of concept formulation; 


(b) Confidence in achieving current program 
objectives; 


(с) Analysis of current risks; 


age Technical feasibility; risks associated 
therewith and analysis thereof; 


(e) Adequacy of integrated logistics support 
planning; 


(je Validity of cost estimates, including 
analysis of cost differences between 
competing Contract Definitron Contractor 
and Government estimates; 


ШӘП Options associated with costi trade-offs 
and analysis thereof; 


(h) Adequate consideration, of contract incen- 
tives and inducement for competition; and 


Go М атат гу of Contractor proposals. 


(3) For systems proposed for initial production: 


ШІ кезсірітісу ol production, including 
evaluation Of milestone achievements, test 
results and production line producibility; 
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(b) 


(с) 
(d) 
(е) 


(f) 


(g) 


(h) 


(1) 


Terchnirealgreasıbrlity, including specifi- 
cation requirements; 


Review and evaluate overall requirement; 
Current varidity of cost estimates; 
Needy. as appropriate, for concurrent 
development and production as well as 
validity of recommended time phasing of 


production/deployment aspects; 


Adequacy of integrated logistic support 
planning; 


The existence of adequate project manage- 
ment controls; 


Adequate planning for Government-furnished 
equipment and facilities; and 


Adequate planning as to proprietary 
rights items. 


пе Chairman may invite other staff members, such 
as the ASD(M&RA) and the ASD(ISÀ) to participate 
in the reviews when the reviews have significant 
relevance to their responsibilities. 


ШЕ She Chairman shall advise the Deputy Secretary of 
Defense of the findings and recommendations of the 
Spemmric review and concurrently a copy of the find- 
ings and recommendations will be forwarded to the 
appropriate Service Secretary. 


ministration: 


The DSARC may establish necessary Working Groups to 
assist the Council members in their reviews. 
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APPENDIX В 


THE DEPUTY SECRETARY OF DEFENSE 
WASHINGTON. D C. 20301 





o OO 


MEMORANDUM FOR Secretaries of the Military Departments 
Director of Defense Research & Engineering 
Assistant Secretaries of Defense 
The General Counsel 
Assistants to the Secretary of Defense 
Directors of Defense Agencies 


SUBJECT: Policy Guidance on Major Weapon System Acquisition 


We have been considering within the Department, for over a year, 
ways by which we can improve acquisition programs for major weapon 
systems. Some steps have been taken which I believe are in the right 
direction (reference my July 31, 1969 memorandum), and it is now ap- 
propriate to move ahead in a concerted effort to firmly establish addi- 
tional new policies and to implement them. 


The prime objective of the new policy guidance is to enable the 
Services to improve their management of programs. Improvement in 
the execution of these programs will be made to the extent the Services 
are willing and able to improve their management practices. The 
Services have the responsibility to get the job done. It is imperative- 
that they do the job better in the future than it has been donc in the past. 


It is the responsibility of the OSD to approve the policies which 
the Services are to follow, to evaluate the performance of the Services 
in implementing the approved policies and to make decisions on pro- 
ceeding into the next phase in each major acquisition program. 

The purpose of this memorandum is to issue broad policy guidance 
which is to be translated into appropriate action by all Services and 
Agencies in new major weapon system acquisitions. 


gu 





Manag ement 


Management in.the Services will be improved only to the extent 
that capable people with the right kind of experience and training are 
designated to manage these major programs -- in fact all programs. 

In order to be effective, program managers must be given adequate 
authority to make decisions on major questions relating to the program 
both in the conceptual development stage and in the full-scale development 
stage. If capable people are going to be willing to undertake these impor- 
tant program management assignments, ways must be found to give them - 
some incentive to do во. Program managers must be given more recog- 
nition toward career advancement in all of the Services, and good managers 
must be rewarded just as good operational people are rewarded. 


If our people are to develop the experience necessary for program 
management and are to utilize their experience, they must be assigned 
to a given program long enough to be effective. 


| The overall structure of the program management function in all 
Services needs to be considered. Changes must be made to minimize 
the numerous layers of authority between the program manager and the 
Service Secretary. 


The entire management problem needs to be addressed under 
these simple guidelines: put more capable people into program manage 
ment, give them the responsibility and the authority and keep therm ther 
long enough to get the job done right. 


Development 


The cost of developing and acquiring new weapon systems is more 
dependent upon making practical trade-offs between the stated operating 
requirements and engineering design than upon any other factor. This 
must be the key consideration at every step in development from the 
conceptual stage until the new weapon goes into the toree. 


The program schedule (structure) is another very key considera- 
tion. It must make sense. It must allow time for accomplishing im- 
portant task objectives without unnecessary overlapping or concurrency. 
The ideal schedule is sequential with enough slack time for resolution 
of those problems which inevitably arise in any development program. 





Conceptual Development 


It is crucial that the right decisions be made during the concep- 
tual stage. If wrong decisions are made during this period the problems 
that are generated cannot easily be overcome later in the program. 


Any new program will contain some risk that the technology in- 
volved cannot, within reasonable time and cost constraints, be converted 
into practical engineering design which meets the desired operating 
requirements, There are three ways in which this technical risk can 
be minimized: 


1. Risk Assessment. The first is to make a careful as- 
sessment of the technical problems involved and a judgment as 
to how much effort is likely to be necessary in finding a solution 
Mot is practical. A careful look at the consequence of failure, 
even of "low risk'' program elements, is also critical. 


2 System and Hardware Proofing. The second and only 


sure way to minimize the technical rısk is to do enough actual 
engineering design and component testing in the conceptual dc- 
velopment stage to demonstrate that the technical risks have 
been eliminated or reduced to a reasonable level. Component 
or complete system prototyping, or backup development, are 
examples of this. 


3, Trade-offs (risk avoidance). Since program risk and 
cost are dependent on practical trade-oifs between stated operating 
requirements and engineering desien, trade-offs must be con- 
sidered not only at the beginning, of the program but continually 
throughout the development stage. 


Proposals for OSD approval of development programs shall in~ 
clude a description of how the Service or Agency intends to manage the 
program to include appropriate attention to (1) Risk Assessment, (2) Svstem 
and Hardware Proofing; (3) Tradeotfs. When a DCP is prepared, it shall 
reflect these in the management plan. | 


Small development projects which do not require specific OSD 
approval shall also be structured to reflect these considerations. 


All new programs will be kept in the conceptual development stages 
until the responsible Service secretary ¿nd the OSD can be assured rat 
the program is actually in the proper shape to procced into full-scale de- 


velopment. 
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Full-Scale Development 


Authorization to proceed into full-scale development will be given 
by OSD based upon a DCP and the recommendation of the DSARC, In 
making this recommendation, the DSARC shall consider іп particular 
whether adequate risk reduction has been accomplished. 


| Even though risk has been adequately addressed during the con- 
ceptual development stages, full-scale development will uncover technical 
and engineering problems that need to be solved. Procedures shall be 
established in the development program by which these problems will 
be continually addressed in view of possible trade-offs with stated opera- 
ting requirements, cost, and operational readiness date, | 


Furthermore, it is essential to have assurance that those problems 
encountered during the earlier development stages have in fact been solved. 
This requires that milestones be established to demonstrate achievement 
of objectives at appropriate points in the development program. These 
milestones shall include such things as completion of appropriate stages 
in the overall system design and testing cf critical items of hardware, 
€. g., Subsystems and components. 


Consideration must be given in development to all matters neces- 
sary in a full operating system. This will include such things as 
maintenance, logistic support, training, etc. However, where these 
matters are dependent on the final production design, as much of this 
work as possible should be delaved until the production stage. In general, 
RFPs for the development stage should be carefully reviewed to eliminate 
demands for reports, documentation and work tasks which are not absolutely 
necessary for the efficient accomplishment of the actual development work. 
These considerations and demands must be limited to those which directly 
contribute to the design of the system itself, 


Production 


The most important consideration before moving into full-scale 
production on a new weapon system is to have assurance that the engineering 
design is completed, that all major problems have been resolved, and this 
has been demonstrated to the extent practical by actual performance testing. 


At the DSARC review when the decision is made as to whether to 


proceed into full production, I want the responsible Service to certify that 
the following actions have been taken: 
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1; All of the milestones which demonstrate the achieve- 
ment of a practical engineering design have been met. 


2. All important cngineering problems encountered 
during the development have been resolved with appropriate 
trade-offs with stated operating requirements so that the 
production, maintenance and operating costs are optimized, 


The start up of production must be scheduled to minimize financial 
commitments until it has been demonstrated that all major development 
problems have been resolved. In most cases production engineering 
and production tooling are necessary to demonstrate that the engineering 
has been satisfactorily accomplished. It may also be necessary to de- 
velop and demonstrate new production processes, methods and procedures, 
Thus, some limited expenditure on production may have to overlap de- 
velopment. 


Contracts 


Mall our contracting, the type of contract must be talloredato the 
risks involved. Cost plus incentive contracts are preferred for both 
advanced development and full scale development contracts for major 
systems. When the assessment of technical risk permits, such contracts 
should include provisions for competitive fixed price subcontracts for 
subsystems, components and materials. In many cases this will enable 
a major portion of the program to benefit from competition. When risks 
have been reduced to the extent that realistic pricing can take place fixed- 
price type contracts should be used. But the contracting Ollicer sho la 
have the flexibility to consider the technical capability of the contra -or 
and other factors in selection of contract type. When fixed-price ty e | 
contracts are used for development programs, the contractor's fin: :cial 
ability to absorb losses that might be incurred must be a factor in rnaking 
the award. 


It is, of course, desirable to award a fixed-price contract іп а 
competitive environment, It has been proven to be difficult or impossible 
to achieve effective competition in a fixed-price-contract for production for 
a major weapon system before full- scale development has been undertaken. 
Consideration should therefore be given to the use of a negotiated fixed-price 
contract after the development has progressed to the point that the produc= 
tion design can be realistically specified. To the extent possible, a contract 
negotiated under these circumstances should encourage competition for 
subsystems, components and materials. In this way a substantial part 
of the cost can be established in a competitive environment. 
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The vse of letter contracts should be minimized. Change orders 
ld not be authorized until they have been contractually priced, or 
until contractual ceilings have been established, 


This guidance is provided to the Services with the understanding 
that it is to be implemented within the established DCP and DSARC 
ies. Other reports and reviews are to be kept to a minimum, but 
the lines of communication between OSD offices and Service components 
must be kept open to insure actual programs are being implemenied under 
this guidance. 


To the extent that the above guidance conflicts with existing DoD 
Directives and Instructions, the policies stated herein will govern, Since 
these policies should be applied immediately, I would appreciate your 
distributing this memorandum to key personnel, including all program 
managers, involved in the acquisition of major weapon systems. 


I want the appropriate regulations of OSD and the Services and 
Agencies to be changed or cancelled to reflect these policies, i have asked 


the DDR&E to take the leadership in accomplishing this and have suggested 
1 September 1970 as the date for recommending changes to me. 


Why 
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DDR&E 


Department of Defense Directive 


OBJECT: Acquisition of Major Defense Systems 


ЦІ. 


UR POSE 


This Directive establishes policy for major defense system 
acquisition in the Military Departments and Defense Agencies 
(referred to as DoD Components). 


BEPRICATION 


This Directive applies to major programs, so designated 
by the Secretary of Defense/Deputy Secretary of Defense 
(referred to as SecDef). This designation shall consider 
(1) dollar value (programs which have an estimated RDT&E 
cost in excess of 50 million dollars, or an estimated Pro- 
duction cost in excess of 200 million dollars); (2) national 
urgency; (3) recommendations by DoD Component Heads or 
Office of Secretary of Defense (OSD) officials. In addition, 
the management principles in this Directive are applicable 
to all programs. 


ROTO Y 


‚A. Mode of Operation - Successful development, production 


and deployment of major defense systems are primarily 
dependent upon competent people, rational priorities and 
clearly defined responsibilities. Responsibility and 
authority for the acquisition of major defense systems 

shall be decentralized to the maximum practicable extent 
consistent with the urgency and importance of each pro- 
gram. The development and production of a major defense 
system shall be managed by a single individual (program 
manager) who shall have a charter which provides suffic- 
ient authority to accomplish recognized program objectives. 





Layers of authority between the program manager and his Component 
Head shall be minimum. For programs involving two or more Com- 
ponents, the Component having dominant interest shall designate the 
program manager, and his charter shall be approved by the cognizant 
official within OSD. The assignment and tenure of program managers 
shall be a matter of concern to DoD Component Heads and shall reflect 
career incentives designed to attract, retain and reward competent 
personnel. 


l. The DoD Components are responsible for identifying needs and 
defining, developing and producing systems to satisfy those needs. 
Component Heads are also responsible for contractor source: 
selection unless otherwise specified by the SecDef on a specific 
program. 


2. Тһе OSD is responsible for (a) establishing acquisition policy, 
(b) assuring that major defense system programs are pursued in 
response to valid needs and (c) evaluating policy implementation 
on each approved program. 


3. The OSD and DoD Components are responsible for program monitor- 
ing, but will place minimum, demands for formal reporting on the 
program manager. Nonrecurring needs for information will be kept 
to a minimum and handled informally. 


4. The SecDef will make the decisions which initiate program commit- 
nts Or increase those commitments. He may redirect a program 
because of an actual or threatened breach of a program threshold 
stated in an approved Development Concept Paper (DCP). The DCI 
and the Defense Systems Acquisition Review Council (DSARC) will 
support the SecDef decision-making. These decisions will be 
reflected in the ext submission of the Program Objective Memo- 
randum (POM) by the DoD Component. 


Eonduct of Program - Because every program is different, successful 
program conduct requires that sound judgment be applied in using the 
Easement principles of this Directive. Underlying specific defense 
system developments is the need for a strong and usable technology 
base. This base will be maintained by conducting research and advanced 
technology effort independent of specific defense systems development. 
Advanced technology effort includes prototyping, preferably using small, 
efficient design teams and a minimum amount of documentation. The 
objective is to obtain significant advances in technology at minimum cost. 


l. Program Initiation 


a. Early conceptual effort is normally conducted at the discretion 
of the DoD Component until such time as the DoD Component 
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2. 


5000.1 
Jublb5. 7) 

determines that a major defense system program should be 
pursued. It is crucial that the right decisions be made during 
this conceptual effort; wrong decisions create problems not 
easily overcome later in the program. Therefore, each DoD 
Component will designate a single individual, such as the 
Assistant Secretary for R&D, to be responsible for conceptual 
efforts on new major programs. 


b. The considerations which support the determination of the need 
for a system program, together with a plan for that program, 
will be documented in the DCP. The DCP will define program 
issues, including special logistics problems, program objectives, 
program plans, performance parameters, areas of major risk, 
System alternatives and acquisition strategy. The DCP will be 
prepared by the DoD Component, following an agreement between 
OSD and that Component on a DCP outline. The Director, Defense 
Research and Engineering (DDR&E)(or the Assistant Secretary of 
Defense (Telecommunications) for his programs) has the basic 
responsibility for coordination of inputs for the DCP and its 
submittal to the DSARC for consideration and to the SecDef for 
subsequent decision. If approved, the program will be conducted 
within the DCP thresholds. 


Scale Development. When the DoD Component is sufficiently 
confident that program worth and readiness warrant commitment of 
resources to full-scale development, it will request a SecDef deci- 
sion to proceed. At that time, the DSARC will normally review 
program progress and suitability to enter this phase and will forward 
its recommendations to the SecDef for final decision. Such review 
will confirm (a) the need for the selected defense system in consider- 
ation of threat, system alternatives, special logistics needs, estimates 
of development costs, preliminary estimates of life cycle costs and 
potential benefits in context with overall DoD strategy and fiscal 
guidance; (b) that development risks have been identified and solutions 
are in hand; and (c) realism of the plan for full-scale development. 


Production/Deployment. When the DoD Component is sufficiently 
confident that engineering is complete and that commitment of sub- 
stantial resources to production and deployment is warranted, it 

will request a SecDef decision to proceed. At that time, the DSARC 
will again review program progress and suitability to enter substantial 
production/deployment and forward its recommendations to the SecDef 
for final decision. Such review will confirm (a) the need for producing 
the defense system in consideration of threat, estimated acquisition 
and ownership costs and potential benefits in context with overall DoD 
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strategy and fiscal guidance; (b) that a practical engineering design, 
with adequate consideration of production and logistics problems is 
complete; (c) that all previously identified technical uncertainties 


_have been resolved and that operational suitability has been deter- 


mined by test and evaluation; and (d) the realism of the plan for the 
remainder of the program. Some production funding for long lead 
material or effort may be required prior to the production decision. 
In such cases, the SecDef will decide whether a DSARC review and 
revised DCP are required. In any event, full production go-ahéad 
will be authorized by approval of the DCP. 


Program @onsiderations 


І. 


System need shall be clearly stated in operational terms, with appro- 
priate limits, and shall be challenged throughout the acquisition 
process. Statements of need/performance requirements shall be 
matched where possible with existing technology. Wherever feasible, 
operational needs shall be satisfied through use of existing military 
or commercial hardware. When need can be satisfied only through 
new development, the equivalent needs of the other DoD Components 
shall be considered to guard against unnecessary proliferation. 


Cost parameters shall be established which consider the cost of 
acquisition and ownership; discrete cost elements (e.g., unit pro- 
duction cost, operating and support cost) shall be translated into 
"design to'' requirements. System development shall be continuously 
evaluated against these requirements with the same rigor as that 
applied to technical requirements. Practical tradeoffs shall be made 
between system capability, cost and schedule. Traceability of esti- 
mates and costing factors, including those for economic escalation, 
shall be maintained. 


Logistic support shall also be considered as a principal design para- 
meter with the magnitude, scope and level of this effort in keeping 
with the program phase. Early development effort will consider only 
Brose parameters that are truly necessary to basic defense system 
design, e.g., those logistic problems that have significant impact on 
system readiness, capability or cost. Premature introduction of 
detailed operational support considerations is to be avoided. 


Programs shall be structured and resources allocated to ensure that 


the demonstration of actual achievement of program objectives is the 
pacing function. Meaningful relationships between need, urgency, 
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risk and worth shall be thereby established. Schedules shall be 
subject to trade-off as much as any other program constraint. 
Schedules and funding profiles shall be structured to accommodate 
unforeseen problems and permit task accomplishment without 
unnecessary overlapping or concurrency. 


Technical uncertainty shall be continually assessed. Progressive 
commitments of resources which incur program risk will be made 
only when confidence in program outcome is sufficiently high to 
warrant going ahead. Models, mock-ups and system hardware will 
be used to the greatest possible extent to increase confidence level. 


Test and evaluation shall commence as early as possible. A deter- 
mination of operational suitability, including logistic support 

guir ements, will be miade prior to large-scale production commit- 
ments, making use of the most realistic test environment possible 
and the best representation of the future operational system available. 
The results of this operational testing will be evaluated and presented 
ле DSARC at the time of the production decision. 


Contract type shall be consistent with all program characteristics 
including risk. It is not possible to determine the precise production 
cost of a new complex defense system before it is developed; therefore, 
such systems will not be procured using the total package procurement 
concept or production options that are contractually priced in the 
development contract. Cost type prime and subcontracts are preferred 
where substantial development effort is involved. Letter contrar's 
shall be minimized. When risk is reduced to the extent that real stic 
pricing can occur, fixed-price type contracts should be issued. changes 
shall be limited to those that are necessary or offer sig.ificant t :nefit 
to the DoD. Where change orders are necessary, they shall be on- 
tractually priced or subject to an established ceiling before authoriza- 
tion, except in patently impractical cases. 


The source selection decision shall take into account the contractor's 
capability to develop a necessary defense system on a timely and 
cost-effective basis. The DoD Component shall have the option of 
deciding whether or not the contract will be completely negotiated 
before a program decision is made. Solicitation documents shall 
require contractor identification of uncertainties and specific pro- 
posals for their resolution. Solicitation and evaluation of proposals 
should be planned to minimize contractor expense. Proposals for 
cost-type or incentive contracts may be penalized during evaluation 
to the degree that the proposed cost is unrealistically low. 
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9. Management information/program control requirements shall provide 


information which is essential to effective management control. 

Such information should be generated from data actually utilized by 
contractor operating personnel and provided in summarized form for 
successively higher level management and monitoring requirements. 
A single, realistic work breakdown structure (WBS) shall be developed 
for each program to provide a consistent framework for (a) planning 
and assignment of responsibilities, (b) control and reporting of pro- 
gress, and (c) establishing a data base for estimating the future cost 
of defense systems. Contractor management information/program 
control systems, and reports emanating therefrom, shall be utilized 
to the maximum extent practicable. Government imposed changes to 
contractor systems shall consist of only those necessary to satisfy 
established DoD-wide standards. Documentation shall be generated 
in the minimum amount to satisfy necessary and specific management 
needs. 


SS IMPLEMENTATION 


l. Each DoD Component will implement this Directive within 90 days and 
forward two (2) copies of each implementing document to the SecDei. 


2. The number of implementing documents will be minimized and necessary 
procedural guidance consolidated to the greatest extent possible. Selected 
subjects to be covered by DoD Directives/Instructions or joint Service/ 
Agency documents in support of this Directive are listed in Enclosure l. 
Each DoD Component will forward the joint Service/Agency documents 
for which it is responsible to the SecDef for approval prior to issuance. 


mclosure 
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5000.1 (Encl 1) 
Jül 13, 71 


Responsibility for the following policy documents is assigned to the 


Cognizant Office indicated. In each case, 


the Cognizant Office shall 


(a) generate the policy, or (5) delegate authority to a lead DoD 
Component for preparation and subsequent issue of a joint Service/ 
Agency regulation, agreement or guide after approval by OSD. 


Polrey Subject 


The DoD Technology Base 

The DCP and the DSARC 

Deferse System Engineering 

Proposal Evaluation and Source 
Selection 

Cost Analysis 

Acquisition of Data 

Cost/Schedule Control Salz: 

Test and Evaluation 

Priorities and Allocations 

Manufacturing Technology 

Quality Assurance 

Logistic Support. 

Standardization 

Value Engineering 
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Cognizant 


Office 


DDR&E 
DDR&E 
DDR&E 
ASD(I&L)/ 
DDR&E 
ASD(SA) 


ASD(I&L) | 


ASD(C) 
DDR &FE 

SDE) 
ASD(I&L) 
ASD(I&L) 
ASD(I&L) 
ASD(I&L) 
ASD(I&L) 


Responsible 
DoD 


Component 


Air Force 


Air Force 
Navy 
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BE Usike PRESENTATION 


Good afternoon, gentlemen. 


І аш CAPT Otth, project manager in the Naval Ship Sys- 
memos GCOmmand for the Patrol Frigate.  VADM Price has out- 
nea the need for the PF Program and stated how the PF 
weapons suite and quantity of ships in the program were 
ved. I will continue this discussion by presenting the 
implementation aspects of the program. I intend to cover 
mese topics: 

Ship design features 
Procurement approach 
Test and evaluation 
Procurement plan 
Production plan 

TLS concept 

Program cost 

Program risks 
Recommended thresholds 


The Patrol Frigate resulting from the trade-off and 
effectiveness studies is shown in this artist's rendering, 


Miner principal design parameters of the PF are: 


Length (WL) (Parameters not 
Beam shown due to 
Navigational draft classification) 


Full load displacement 
Sustained speed 
Maximum speed 
Endurance 


ADMIRAL Price has discussed how the mission analyses 
were translated into the required conceptual ship with it 
characteristic weapons and sensors. The chosen conceptual 
design was the result of many computer iterations of pay- 
load and hull combinations which gave us a high level of 
confidence concerning all salient aspects of the ship design. 
Even this level of confidence, the CNO set cost, displace- 
ment and personnel accommodation goals shown here: 


Cost S45M (average cost follow ship 73$) 


On balance, the additional $3M investment in a second 
shaft is truly not cost effective. 
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Twin screws are obviously more desirable in terms of 
Being casualties per se and ship maneuverability in 
restricted waters. In PF we have addressed this by pro- 
ED 3 retractable electríc drive auxiliary propulsor 
E ted here. This unit is capable of 'taking home’ the 
ship at 4-5 knots in calm seas, and has the added advantage 
аза 5 С1пр maneuverability in restricted waters. 


Tineo now to the procurement aspects of the program 
we have structured the approach for compliance with DOD 
ier o000.1 and to incorporate the best features of past 
Seep procurements. To do this we have planned four 
acquisition phases as shown. We are presently four months 
into the ship system design phase which leads to the con- 
Meeacting baseline for the lead ship. Assisting us in this 
effort are two competitively selected shipbuilders. The 
first, Bath Iron Works Corporation, has been designated 
ши lead shipbuilder. In addition to participating with 
NAVSEC in preparation of the ship system design and speci- 
fications the lead shipbuilder will perform planning, 
detail design, and long lead equipment procurement services 
authorized by the Navy. The second shipbuilder, Todd 
EU vards, Inc., participates with NAVSEC to assure that 
ШЕШЕ Evolving design does not favor the facilities or capa” 
bilities of the designated lead shipbuilder and that the 
final design will be suitable for competitive procurement 
MO Llow ships. 


exp loiting information derived from the lead ship 
Mee we plan to refine the lead ship baseline to produce 
a more precisely engineered instrument for series produc- 
Mon Of follow ships. 


ши сортоасћ to DODDIR 5000.1 also incerporates an 
extensive test program. 


Supplementing and anticipating the lead ship construc- 
шш we plan to erect full scale land based test sites 
Mmrdavidually for the propulsion and combat systems. The 
objectives of these facilities are shown here. 


In addition to providing the means for validating the 
design engineering aspects of ship integration and the 
ENduct of requisite test and evaluation of the critical 
PF systems, the two land based test sites will assist in 
me configuration management of the PF propulsion and 
membat systems. Throughout the life of the PF program, 
these sites will be used to evaluate change proposals 
Menor to application to the ships. 
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Euer the initial validation of system integration the 
two land based test sites will also be used to validate 
Operational test and support concepts proposed for the PF. 
Encaddition they will serve as system level training 
facilities. 


ШШЕ central relationship of these test sites to the 
Ship acquisition schedule is depicted here. Land based 
Meseing is used in concert with IOT&E plans for individual 
Sauapments not now in inventory to achieve requisite level 
Ot confidence in the design engineering of ship and equip- 
Memenbperore we commit to producing either in quantity. 

Note that land based testing and equipment IOT&E schedules 
provide for proofing of key systems two years before comple- 
En of the lead ship and coincides with our planned award 

Ш ЕЕ for follow ship construction contracts, shown by this 
ical time line. At this point we will have sufficient 
Evidence in the combat system/ship integration to warrant 
lou Ship series production. Additional testing and 

E meunent will ensue at the test sites to generate data 

the Navy and shipbuilders will need later to install and 
check out these systems. 


build further confidence in the validity of the 
sien for the follow ships, the scheduled start of follow 
Construction is contiguous with completion of lead ship 
ШОШ cation. By the start of follow ship construction, the 
Ea design will be over 3 years mature and validated. 


ES, the PF approach is oriented to minimizing changes 
Mees actual construction of the follow ships. 


As an example of an equipment IOT&E plan complementing 
BIEZEBTS, here is the schedule for the MK92/2 FCS which 
culminates in at sea tests in a DEG. It will undergo 
factory acceptance tests from May to July 1974. The system 
LU be installed in the DEG along with the 76mm gun during 
summer 1974. Then these systems will be demonstrated in 
Mi inction with the ship's tartar launching system. In 
about the same time frame the pilot production MK92/2 
System will complete factory acceptance tests and deliver 
to the LBTS for integration. These correlative evaluations 
are scheduled so as to attain sufficient confidence to 
Proceed with production by February 1975. 


Finally, we will establish a follow ship baseline which 
is more heavily endowed with non-deviation drawings than 
any previous surface ship procurement. Where performance 
requirements best serve, we will be able to use them more 
precisely as a result of the technical maturity of the ship 
design. 
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ша агаігасСіоп, of course, bears a very central rela- 
Шар to PF integrated logistic support planning. Our 
стра! ІГ5 оБіесііуес аге: 


ie БӘ шіпішіге organizational level maintenance, 
шшаебу reducing associated ship manning, and 


feo minimize the off-line time of the PF for 
Мите depot level maintenance, thereby increasing 
lization of the ship. 


тате, 1 believe, put emphasis on first things first. 
Mor example, the ship design has been influenced strongly 
Ma. Tequirement to provide easy access to equipment for 
e in place maintenance, and where appropriate, for 
moval. Transfer of maintenance workload from ship to 
Oe will require careful planning. As an example, we 
have studied the 

(pages following omitted) 


mioeated baseline is completed. This amount is needed 
for timely prosecution of ship system and detail design 
mma procurement of long lead time equipment for the land 
based test sites and the lead ship. Award of the lead 
E Construction contract is planned for the fourth 
quarter of FY73. 


IIS Slide lists the salient program risk items. The 
ES are essentially to program schedules--there is little 
technical risk involved. We are developing detailed plans 


for monitoring the progress of each item in depth and 

Will be aware of any problem areas as soon as they arise. 
Alongside each item in the slide is the risk management 
goal and the correlative target and threshold dates by 
which we expect to have sufficient confidence to proceed 
with follow ships. Here again are shown the aspects of 

E PE procurement’ plan relating to DODDIR 5000.1. So lor; 
aS we can resolve risks in relation to these milestone 
requirements we are avoiding concurrency. We would there- 
meme propose that this watch list be included in the pcp 
with the requirement that we notify you when and if trouble 
develops and identify a remedial course of action. 


Shown here are the recommended thresholds for the PF 


Program. Costs are exclusive of shipbuilder escalation, 
post delivery changes and outfit. The schedule milestones 
Elect the watch list data in the previous slide. Of 


course we have many other management milestones which we 
ШЕП Show you if desired. 


In summary, I have discussed the ship design features 
the PF which are innovative to insure an effective yet 


146 





Mess expensive ship. The PF procurement plan is structured 
Shni pbuilding in full accord with the intent of DODDIR 
OUI. Those systems which have significant impact on 
EN Gss in terms of whole ship integration or individual 
performance, namely weapons, sensors and propulsion, are 
Bombe carefully evaluated and integrated both ashore and 
where advisable at sea prior to commitment to series pro- 
duction of equipment or follow PF's. I have outlined the 
Bock procurement plan which is phased judiciously to 
allow the lead ship design to mature to confident produci- 
Шу before the Navy embarks on program expansion. 


From the onset of ship system design the program has 
involved an integration of industry and service talent 
шматга mutual understanding and confidence. The PF program 
has certain risk items which we will monitor closely to 
insure earliest identification of problems and development 
enpr oper remedial action. Program costs have been main- 
tained essentially within established goals; however, 

"then year' escalation effect cannot be accurately forecast. 
EN e nevertheless committed to continue to drive unneces- 
mary costs out of the program. Finally, we have recommended 
what we believe are reasonable thresholds for program 
prosecution. 


Weare seeking authorization of the lead ship, the land 
based test sites and series production of 49 follow ships 
EN o blocks. Production of follow ships will be on condi- 
Спа: satisfactory IOT&E is achieved, and at that time 
E Navy will verify satisfactory IOTSE, review the program 
TS and request ratification of the production decision. 


This concludes my prepared remarks. ADMIRAL Price and 
EEUU] now be happy to entertain any questions. 
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CNO IMPOSED GOALS 





Пост $45M 


(average cost 
foll oym hip 735) 


UTE LOAD DISPLACEMENT 3400 TON 


ACCOMMODATIONS Poo TOTAL 


(several slides omitted) 
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THE DEPUTY SECRETARY OF DEFENSE 
Waskineton, p. G. 20301 


Sep ео т2 
РИМОКАМУМ FOR THE SECRETARY OF THE NAVY 


ШЕСЕСІТІ: Patrol Frigate Program 


mem DoARC review of the Patrol Frigate (PF) Program held 
31 August 1972 found that the Navy had done a commendable 
mM the efforts to design the PF to a cost goal of $45M 
ШЕР ІЗ dollars) per ship. This is an excellent start, but 
EE Teal job lies ahead in producing the ships within the 
Mest goal. Based on past experience, this is going to be 
ME c difficult task requiring both ingenuity and strong 
discipline. 


Mama pleased to note the strong effort to insure adequate 
EST and evaluation (including IOT&E) prior to major con- 
tract for follow ships. However, the planned date for 

N iirst major contract for follow ships assumes that no 
Metical deficiencies will be found during such testing. 
The Navy Should continue to give emphasis to the completion 
of all feasible early T&E (including IOT&E) on the combat 
subsystems and on the land-based test sites. The DSARC 
and the DDT&E will evaluate at the time of their review of 
the Navy's recommendation to proceed with follow ships 
whether adequate test and evaluation (including IOT&E) 

has been accomplished with satisfactory results, and if 
not, whether some delay in contracting is warranted. 


Also, it may be desirable that a period for operational 

mest and evaluation of the lead ship, prior to that ship's 
full release to normal Fleet usage, be allocated to OPTEVFOR. 
The purpose of this testing would be to determine the 

PF's expected operational effectiveness in its expected 

Poles and the need for any early modification to follow 

Ships. Should such modifications be required, a later DSARC 
“ould have to determine the relative merits of opening 
existing contracts to change by change order procedures 

or making modifications after acceptance from the shipbuilder. 


I have reached the following decisions: 


a. The Navy is authorized to proceed with the program 
for development and construction of the PF lead ship and 
Jand-based test sites and advance procurement funding -- 
$191.5M in FY 1973 for lead ship and land-based test sites 
and $17.0M in FY 1974 for advance procurement funding. 
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b. The Navy should continue its planning on the basis 
Ene block construction schedule indicated іп the DCP 
Meer tne FYDP (24 ships followed by 25 ships, the first 
mock tO be awarded to at least three different ship- 
builders). The number of PF follow-on ships and/or the 
Meee rOr any further study will be determined through the 
POM process, 


аю days in advance of a proposed DSARC III, ап 
 бүша! review of program test results and contract plans 
will be provided. 


ШО Mpproval of follow ship production should be con- 
Event upon accomplishment of adequate test and evaluation 
(including IOT&E individually on subsystems, and collectively 
Elana based test sites) with satisfactory results. Data 
from such tests must be made available for examination prior 
SOS DBSARC III, now scheduled for March 1975. Jn addition, 

ШЕН 5(1с5 support for the all new systems and training and 
Manpower allocations to support all new requirements shall 
be presented at the same time, 


БЕН ihe Navy is requested to develop a plan for, and 
evaluate the impact of assigning the lead PF to OPTEVFOR 
Шек a reasonable period to complete an at-sea operational 
mepraisal of the PF as a whole prior to the lead ship's 
EU release for Fleet usage. This, plan and evaluation, 
together with the Navy's recommendations, should be sub- 
meted to OSD at the time of preparation of the revision 
ПИЛЕ PCP for initiation of construction of the first 
Follow ship. 


fein light of the strong start the Navy has made in 
KI Sien of the PF to a cost of about $45M (FY 73 dollars 
unescalated), I want to insure that all efforts are made 
ШОШ из ите that the-cost goal is achieved in production. 
Meme retore direct that all periodic management and DSARC 
reviews highlight the Navy's performance in meeting a 
E03] of S45M (in FY 73 dollars excluding shipbuilder 
Escalation and outfitting and post delivery costs) and 
the reasons for any increases. A threshold of $50M under 
the same stipulations will be established in the DCP. 


Deferred funds will be released by separate action. 


/s/ Kenneth Rush 
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DSARC CHECKLIST — PROGRAM DECISION 


HAS CONCEPT FORMULATIOt BEEN COMPLETED? 
is the Program ready to transition to validation? 


1. Operational/Mission: 


a. Threat/military need/opportunity—how well defined? How credible? How stable 
or timely? 

b. Operational concept and objectives—new tactics or doctrine required? Tested 
or gamed against threat? Results? 

c. How important is this capability? Ranked with other capabilities? 

d. Below what capability level is this not worth doing? Above what capability level 
are technical, cost, or schedule risks too great? 


2. System Alternatives and System Analysis: 


a. What alternatives considered? Cost effectiveness of each (operational performance 
and reliability vs cost and schedule)? 

b. What measures of effectiveness considered and used? Sensitivity analysis? Results? 

c. Validity of key assumptions? Who agreed to these? 

d. Confidence in the system analysis? Thoroughness? Objectivity? Who did it? 

e. Best arguments for and against each alternative? Risks? Criteria for selection? 


3. Technical: 


a. Primarily engineering or experimental? Most diflicult characteristics? Ranking 
of approaches by technical risks? Formal Risk Analysis? 

b. State-of-the-art for key subsystems and components? Design validate by lab- 
oratory demonstration? Back-up programs? 

c. Confidence in achieving technical objectives in time апа до аг budge 3? Effect 
on operational performance and budgets if only “most likely” rather than ој imistic 1s 
achieved? At what level of technical achievement should program be killed? Pe: formance 
thresholds? 

d. Preliminary performance specifications prepared? How much can bidders vary 
from specified approaches? 

e. Test and evaluation plan consistent with proposed program commitments? 


4. Cost: 


. Confidence in cost estimates? Development? Production? O&M? 

. Who made cost estimates? How? Does estimator’s position make him optimistic? 
. Have costs been validated by OASD (systems analysis)? 

. Cost of proposed program vs. comparable items? How sensitive to schedule? 

. Would contractors take contract at estimated cost if no way to “get well”? 


с” y 


о с.о 


5. Schedule: 


a. Confidence in schedule estimates? Development? Production? IOC? 
b. Schedule of this prograin vs. comparable items? 
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c. Urgency of schedule? Why not slip IOC date? аў 
| d. Pacing items? Confidence that schedule for these will be met? Defer program | 
commitment until more confident? 
e. Schedule thresholds? 


6. Procurement: 

a. Alternative contractor structures (prime, associate)? Pros and cons? 

b. Kinds of contracts (CPFF, FFP, FPI, etc.)? Are these same for Validation Phase, 
development, production? Are these appropriate? Pros and Cons? 

c. How to limit premature Government commitment? By Achievement Milestones in 
contracts? Excessive contractor risks? 

d. Initial procurement —how competitive? Iow to maintain competition? 

e. Procurement plan, e.g., Validation Phase followed by Full Scale Development; 
parallel competitive development, etc.? : 

f. Indicate what has been done to scrub RFP of unnecessary or marginal performance, 
management and data requirements. 


g. Has Advance Procurement Plan (APP) been prepared? Has a copy been forwarded 
to OASD(I &)? 


7. Program Management: 

a. Service management of contractors- how much? What kind? Monitor? Control? 

b. Service Program Manager-—how long on program? Experience? Authority for en- 
gineering and contract changes, funding, etc.? Number of approval levels between Pro- 
gram Manager and DepSecDef? 

c. His staff now? Later? Their experience? Capability? Other help, e.g., FCRC, Gov- 
ernment Lab? Independent capability for important areas (contracting, reliability, etc.)? ) 
Tenure of key members of PM staff? we 

шаг Joint Service Programs has Joint System/Project Manager Charter been 
established and approved? If Not, Explatn? 


8. Presentation. The presentation should relate to and include comments on the DCP, spe- 
cifically addressing the issues contained in the DCI. The presentation must reveal the 
status of the program's readiness to transition to the next phase; that is, that the pre- 
requisites to Validation Phase have been satisfactorily accomplished). 

a. Primarily engineering rather tlian experiinental effort is required, and the tech- 
nology needed is sufficiently in hand. а 

b. The mission and performance envelopes are defined. 

с. The best technical approaches have been made. 

d. A thorough trade-off analysis has been made. 

e. The cost effectiveness of the proposed item has been determined to be favorable 
in relationship to the cost effectiveness of competing items on a DOD-wide basis. 

f. Cost and schedule estimates are credible and acceptable. 


У. 
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DSARC CHECRLIST — RATIFICATION DECISION 


HAS VALIDATION BEEN COMPLETED? 


is the program ready to enter full scale development? 


1. General: 


a. Have program objectives changed since CF/Validation Phase completed? How 
and why? | 

b. Confidence in achieving current objectives (operational performance, cost, sched- 
ule)? Basis for confidence? 

с. New risks or increases in already known risks identified in Validation Phase? Total 
risk greater or less than before Vahdation Phase? 

d. Significant changes in key premises or characteristics? Jf yes, reassessment of 
new estimates vs. military value? Thresholds on key characteristics or premises? 


2. Technical: 


a. Proposed development vs. present state-of-the-art? Primarily engineering: rather 
than experimental? 

b. Was design extended far enough in Validation Phase to identify risks? Name 
highest risk areas—how risky? Design validation of risk areas? Back-up progranis needed? 
With these risks, should we proceed with “hard” development contracts? 

c. Significance of variations in technical aspects by competing Validation Phase 
contractors? How or why is winner's the best? 

d. Are performance and test specifications matched to prograin, state-of-the-art, 
kind of management? Flexible enough without contract changes? 

e. Test and Evaluation plan consistent with proposed program commitments? Inte- 
grated test program? 


3. Cost: 

a. How realistic are cost estimates? Basis? All significant cost elements; for example, 
test facilities/equipment) ineluded? 

b. Significant differences in cost estimates between Government and contractors? 
Analysis of these differences? Do they give clues to uncertainties in real cost? Clues to 
whether we should go ahead? 

c. Have program costs been validated by OASD (systems analysis)? 

d. Compare cost estimates for this program to similar programs? Differences? Anal 
ysis of differences? | 

e. What program features most affect total cost, funding rate, R&D vs. other funds? 
What program options (examples: change overall schedule, do pacing subsystems first, 
test less before production release) help cost or funding? Program designed to avoid 
excessive funding peaks? Excessive early expenditures? 


4. Schedule: 


a. How to preserve IOC date and minimize early resource commitments? What parts 
of program are deferrable? For how long? 
b. Realism of IOC date; that is, will all necessary items be ready (tactics, trained 
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people, facilities, test equipment, spares, etc.)? Who is making these schedules mesh’? 
Non-R&E resources programmed? 

c. Difficulty of schedule? Pacing elements? Which ones most likely to slip? Action to 
reduce this risk? 

d. Significant differences in schedules by competitors? Analysis of these differences? 
Clues to uncertainties and the real contract schedule? 


5. Program Management: 


a. What is the service management staff for this program? Adequate? Need to do 
something; for example, high-level program manager, get him more help? His tenure and 
that of his key personnel? 

b. Service management concept tailored to program, contract type, etc.? How will 
contractor be managed (monitor, control)? 

с. Government and contractor cost, schedule, technical performance reporting sys- 
tems? Will they predict? How close to real time on major aspects? 

d. Any new management systems or techniques? What are they? 

е. For joint service program-have joint service operating procedures been de- 
veloped--if not explain. 

6. Management: | 

a. Has updated Advance Procurement Plan been submitted to OASD(I&L)? 

b. Procurement plan matched to program and risks? Contract type consistent with 
risks? Contractual achievement milestones? 

c. Contract negotiated while competition existed. Contract incentives? Do they 
motivate? Importance to us? 

d. “Goodness” of contract from Government view? Contractor’s? 

e. Additional commitments by contractor; for example, production options? Adequate 
flexibility for Government? 

f. What happens if contractor gets in trouble? What options does the Government 
have? 

£g. Is this a “buy-in”? Any contract features to help contractor “get well’? Pı vent 
him from “getting well’? Has suspected “buy-in” been discussed with bidder’stop m: age- 
ment? 


7. Contractor and Proposal: 

a. Best contractor or best proposal? How better? Strong points? Weak points? 

b. Difference in evaluation of competing proposals? Winner best in which areas? Are 
they the most important areas? 

c. Competence of winner and loser, judged by Validation Phase effort alone? Past 
records of competitor (cost, schedule, performance)? Other factors evaluated? 

d. Importance of program to contractors? Contractor's Validation Phase team to do 
development? Continuing high-level attention? 

e. Major associate and subcontractors identified and committed? 

f. Indicate what was done to scrub the RFP and proposal of unnecessary and marginal 
requirements for performance, management, and data requirements. 


8. Presentation. The presentation shall ascertain that the program proposed to go forward 
15 consistent with the DCP and its thresholds. 
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DSARC CHECKLIST —PRODUCTION DECISION 


HAS DEVELOPMENT BEEN COMPLETED? 


Is the system ready for release to production? 


1. General: 

a. Significant program changes during development? Examples: expected operational 
availability date? initial production cost? military need? utility of item this is to replace? 
technology breakthrough? program objectives? 

b. Compare original program goals (cost, schedule, performance) with current ex- 
pectations. 

c. Originalevaluation of importance of this capability vs. current evaluation. 


2. Technical: 

a. Status of development? Any items not design frozen? Any prototype items not yet 
fabricated? What tests not yet completed? Integrated prototype lab tests? Operationally 
tested? Reliability tested? All achievement milestones completed (prerequisite to pro- 
duction)? 

b. Status of accessory and auxiliary items? Test equipment/facilities? Training 
equipment, materials/instructions? Nucleus of trained people? 

c. Remaining technical risks. Rate and significance of design changes? 

d. New technology to be considered before production? 

e. Status and quality of specifications? 

f. Test program consistent with proposed program commitments? Integrated test 
program? 


3. Cost: 

a. How realistic are production cost estimates? Basis? All significant cost elements; 
for example,test facilities/equipment included? 

b. Have program costs been validated by OASD (systems analysis)? 

c. Compare production cost estimates for this program to similar programs. Differ- 
ences? Analysis of differences? | 

d. What program alternatives may help cost and funding? (Examples: schedule 
change, breakout, open up for competition.) 

e. What program features most affect future costs? Funding rate? Program designed 
to avoid excessive funding peaks? Excessive early expenditures? 


4. Schedule: 

a. How to preserve IOC date and minimize early commitments? 

b. Do what now to improve probability of meeting schedule? Pacing items? Which 
most likely to slip? 

c. How much concurrency and schedule compression? Necessary? Gains vs. risks? 
Extra resources or management action required because of compression? 

d. What factors external to program (threat; associated hardware, construction, or 
software) most influence schedule? 

e. Realism of IOC date; that is, will all necessary items be ready (tactics, trained 
people, facilities, etc.)? Who is making schedules mesh? Non-R&D resources programmed? 
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5. Procurement: 


a. Has updated Advance Procurement Plan been submitted to OASD (I&L)? 

b. Size of first production buy? Why this quantity? Priced options for additional 
quantities? Adequate Government flexibility re options? 

с. First buy competitive? Pros and cons? When competitive? 

d. Under what circumstances will first buy be competitive? What criteria for selec- 
tion? How important is cost? Technical? 

e. What has been done to assure that technical data package is adequate for pro- 
duction release? When? Pilot Production? Reviewed by independent agency? Bind con- 
tractor to data package or performance requirements? 

f. Does contract contain provisions to assure adequacy of data package for production 
prior full-production release? Options? 

g. Indicate what was done to scrub RFP and proposal of unnecessary and marginal 
performance, management and data requirements. 


6. Program Management: 


a. Service management concept tailored to program and contract type? How will 
contractor be managed (monitor, control)? | 

b. Government and contractor cost, schedule, technical performance reporting 
systems? Will they predict? How close to real time on major aspects? 

с. Configuration management? Integrated logistics support? Other important man- 
agement information systems? 

d. Present (and planned) integration between design and production engineering? 
Motivation to design for producibility? When will production contractor enter program 
Qf different from developer)? How to transfer know-how from developer? 

e. Service management staff? Adequate? How different for production phase? Early 
field engineering support? Continuing technical support? Tenure of project manager and 
key personnel. Authority re support organizations? Authority for changes to contract, 
specifications, funding, ete.? 


7. Presentation. The presentation shall ascertain that the program proposed to go forward 
is consistent with the DCP and its thresholds. 
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APPENDIX 
CHECKLIST FOR MIILESTONE I REVIEWS 


(END OF CONCEPTION PHASE AND 
ENTER VALIDATION PHASE) 


Purpose of Milestone I ASARC/DSARC. 


The purpose of the Milestone I review is to determine whether or not 
the Conceptual Phase has been completed and whether the program is 
ready to transition to the Validation Phase. The Milestone I review will 
be held at such time that the Army has determined that— 


a. The system satisfies a real military need, is worth its cost and is of 
sufficient priority to be funded within overall fiscal contraints. The pro- 


posed development is in consonance with the Required Operational Capa- 
bility (ROG). 


b. Mission profiles and performance envelopes are adequately defined 
and are based upon sound and balanced military, technical and economic 
objectives. 


c. Major uncertainties are identifed and a suitable method of resolu- 
tion is planned for the Validation Phase. 


d. Preliminary cost and schedule estimates are realistic and accept- 
able. 


e. The management approach and program planning are sound. 


f. The DCP/DPM/APM thresholds are well defined and provide tł 
flexibility for accomplishing the appropriate trade-offs in the Validatic . 
Phase while insuring the surfacing of-siguificant problems. 


g. Critical questions and issues associated with operational suitability, 


effectiveness, C-E systems, electromagnetic compatibility, the adequacy 


and essentiality of signal security features and characteristics and fre- 
quency supportability are identified to the maximum extent possible. 


h. The environmental impact is minimized and acceptable. 


i. Logistic planning appropriate to the Conceptual Phase has been 
accomplished. 


1. BACKGROUND. 


The presentation should relate to the ROC and the DCP/DPM/APM, 
specifically addressing issues and the viability of thresholds. It must ad- 
dress the program's readiness to transition to the next phase (i.e., pre- 
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requisites). The presentation shall assure that the proposed program is 
consistent with the DCP/DPM/APM. The operational, technical, schedul- 
ing, costs, procurement and program management considerations of in- 
direct or “spillover” effects of the system should be addressed. 


2. OPERATIONAL ASSESSMENT. 


a. Threat/military need/opportunity—how well defined? How cre- 
dible? How stable or timely ? Precise statement of the ROC? 


b. Operational concept and objectives—new tactics or doctrine re- 
quired? Tested or gamed against threat (to include EW and SIGINT 
exploitation) and appropriate environments including tle electromagnetic 
environment? If the system radiates electromagnetic energy, has a con- 
ceptual, formal vulnerability analysis been performed? Results? 


c. Has the Army Analysis of Intellirence (AAT) been considered in 
the development of the threat or separately developed threats been coor- 
dinated with ACSI during each stage of development? 


d. How important is this capability? Ranked with other capabilities? 


e. Below what capability level is this not worth doing? Above what 
capability level are techmical, cost, or schedule risks too great? Target 
level established by trade-offs? 


f. Have issues to be addressed through operational testing been iden- 
tified? 


g. Does the test program adequately address operational mission is- 
sues? 


9. SYSTEM ALTERNATIVES AND SYSTEM ANALYSIS. 


a. System alternatives. 


(1) What alternative systems and system:designs have been con- 
sidered? Present system considered? Cost and benefits of each (opera- 
tional performance, reliability, maintainability and electromagnetic cap- 
ability versus total life-cycle cost to include electromagnetic frequency 
- Spectrum usage and schedule) ? 


(2) What measures of benefits/effectiveness considered and used? 
Sensitivity analysis? Results? Issues in need of operational testing? 


(3) Confidence in system analysis? Thoroughness? Objectivity? 
Agency doing system analysis? А 

(4) Best arguments for and against each alternative? Risks? 
Criteria for selection? 


(5) Marginal features? 


b. Cost and benefits analysis. 


(1) Confidence in cost estimates to include parametric cost analy- 
ses? Development? Production? Cost of ownership? MCA? 


(2) Confidence in benefits of effectiveness estimates? 
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(3) Who made estimates of cost? Of effectiveness? How? How was 
objectivity assured? Have the costs been explained in terms of required 
effectiveness for all or part of the forces in terms of realistic contingency 
missions (quality and quantity trade-off analysis). 

(4) Have costs been validated by COA and/or OASD (Systems 
Analysis) ? 

(5) Cost of proposed program versus comparable items in com- 
parable dollar terms? How sensitive to schedule? 


(6) Are DCP/DPM/PM itemized costs expressed in both constant 
and then year dollars? 


(7) How have provisions been made to assure traceability of esti- 
mates? Will overhead estimates for both the in-house and contractor 
costs be visible throughout the program? 


(8) How will the program insure that discrete cost elements will be 
translated into “design to” requirements? 


(9) Is the impact on the electromagnetic spectrum considered in 
the cost and benefit analysis ? 


4. TECHNICAL ASSESSMENT. 


a. Primarily engineering or experimental? Most difficult charac- 
teristics? Ranking of approaches by technical risk? Formal Risk Analy- 
sis? Relate consequence of failure to risks. 


b. State-of-the-art for key subsystems and components? Design vali- 
dated by laboratory demonstration? Back-up programs? Amount of test- 


ing accomplished to eliminate or reduce risks? Assessed in technical por- 
tionof RFP? 


c. Confidence in achieving technical objectives in time and dollar 
budgets? Effect on operational performance and budgets if only “most 
likely” rather than optimistic is achieved? At what minimum level of 
technical achievement should program be stopped? 


d. Do performance thresholds permit trade-offs? 


e. Critical OTE questions and issues as identified in the DCP/DPM/ 
APM and CTP? Identify critical questions and issues which must be 
answered by Development and/or Operational Test and Evaluation and 
outline the plan and schedule milestones for accomplishing. 


f. Are the test and evaluation issues covered in the DCP/DPM/APM 
and is a proposed schedule of test milestones included? Is adequate time 
scheduled for test results to be available for consideration prior to deci- 
sion? 


g. Effort planned for Reliability and Maintainability improvement to 
reduce O&M costs. Have Reliability and Maintainability goals been es- 
tablished? Relate these to mission requirements. 


h. Is a competitive prototype program warranted? Is competitive 
leverage of risk reduction suflicient to provide overall life cycle cost re- 
duction? 
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1. Will electromagnetic compatibility be assessed to a satisfactory 
degree? 


1. Does DCP/DPM/APM address system susceptibility to EW and 
SIGINT exploitation. 


k. Have all means been considered to eliminate or minimize degrada- 
tion of the environment? 


5. SCHEDULE. 


a. Confidence in schedule estimates? Development? Production? 
JOC? 


b. Schedule of this program vs comparable items? 


c. Urgency of schedule? Why not slip IOC data? What drives re- 
quired JOC date? Relate this to any concurrency. What are the essential 
trade-offs? 


d. Pacing items? Confidence that schedule for these will be met? 
Defer program commitment until more confident? 


e. What provisions have been made for trade-off with cost and system 
capability? 


6. PROCUREMENT ASSESSMENT. 


a. Procurement plan, e.g., Validation Phase followed by Full-Scale 
Development Phase; competitive prototypes; parallel development; kinds 
of contracts (CPFF, FFP, FPI, ete) for validation, full-scale development, 
production: Are these appropriate? Pros and cons? 


b. Alternative contractor structures (prime, associate)? Pros and 
cons? 


c. How to limit premature Government commitment? Achievement 
Milestones in contracts? Excessive contractor risks? 


d. Initial procurement—how competitive? How to maintain competi- 
tion? 2 
е. RFP scrub of unnecessary or marginal performance, management 
“апа data requirements? What required reports and data unnecessary? 
f. Has Advance Procurement Plan (APP) been submitted to ASA- 
(T&L), ASA(R&D), and ASD(I&L) for review? 


g. How did the source selection take into account the contractor's 
capability to develop a necessary defense system ón a timely and cost- 
effective basis? 


T. PROGRAM MANAGEMENT. 


a. Management system for program control. Will MIL STD 881 and 
DODD 7000.1 be fully implemented? 


b. Army management of contractors—how much? What kind? Moni- 
tor? 
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с. Army Project Manager—how long on program? Planned tenure? 
Experience? Authority for engineering and contract changes, funding, 
etc.? Number of approval levels between Project Manager and DEP- 
SECDEF? 


d. His staff now? Later? Their experience? Capability? Other help, 
e.g., FCRC, Government Lab? Independent capability for important areas 
(contracting, reliability, etc.)? Tenure of key members of PM staff? 


e. For Joint Service Programs has Joint System/Project Manager 
Charter been established and approved? If not, explain. 
8. ASARC/DSARC REVIEWS INVOLVING SOURCE SELECTION. 


a. Unsuccessful bidder status? Provide summary comparing the pro- 
posed programs of unsuccessful bidders with winning bidder(s). 


b. Credibility of cost/perofmance proposed? 

c. Did any bidder claim that Government requirements were unrealis- 
tic? What basis? 
9. SECURITY. 


Summarize the security classification of the program; system, com- 
ponents, technical characteristics and any other aspects of the program 
requiring classification. 
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CHECKLIST FOR MILESTONE II REVIEWS 


(END OF VALIDATION AND BEGIN 
FULL-SCALE DEVELOPMENT) 





Purpose of Milestone II ASARC/DSARC. 


The purpose of the Milestone II review is to evaluate the readiness 
of the program to enter Full-Scale Development. The Milestone II re- 
view will be held at such time that the Army has determined that: 


a. Appropriate analyses (trade-off, parametric cost, cost and effective- 
ness) are available to confirm the need for the system in consideration 
of the threat, system alternatives, special logistic needs. communications- 
electronics impact, estimates of development cost, preliminary estimates 
of life cycle costs and potential benefits in context with overall Army 
strategy and fiscal guidance. 


b. The system still satisfies a real military need, is still worth its 
cost, and is still of suflicient priority ‘to be funded within overall fiscal 
constraints. The development is in consonance wiih the ROC. 


c. Risks have been reduced to acceptable levels and a suitable method 
of resolution is identified in areas of residual technical risk. 


d. System trade-offs have produced a proper balance between cost 
and performance. 


€. Cost and schedule estimates are realistic and acceptable. 


f. System configuration and performance specifications have been de- 
veloped sufficiently to permit Full-Scale Development to begin. 


g. The management approach and program planning are sound. 
h. The contractual aspects are sound. 


i. The DCP/DPM/APM thresholds are well defined and provide suf- 
ficient flexibility for engineering development white insuring the surfacing 
of significant problems. 


j. Critical test issues, as identified in the DCP/DPM/APM and the 
CTP, have been reviewed and refined to determine what T&E (including 
OTE) must be scheduled and conducted. 


k. Electromagnetic compatibility and frequency supportability have 
been evaluated as being satisfactory. 


І. Verification that environmental objectives can be attained. 
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m. The analysis of vulnerability to hostile EW ang SIGINT exploita- 
tion is updated and appropriate hardening trade-off analyses accomplished, 
as appropriate. 


n. Logistics planning appropriate to the Validatian Phase has been 
accomplished. 


1. BACKGROUND. 


a. Have program objectives changed since Conceríual Phase comple- 
tion and during Validation Phase? How and why? 


b. Significant changes in kev premises or charicteristics? If yes, 
reassessment of new estimates vs military value? Thre:holds on key char- 
acteristics or premises? 


c. Threat still credible (conforms with the AAI er has been coordin- 
ated with ACSI)? 


d. Confidence in achieving current objectives (ozerational perform- 
ance, electromagnetic compatibility, reliability, cost, sshedule) ? Basis for 
confidence? 


e. Formal risk analysis made—New risks or itcreases in already 
known risks identified in the Validation Phase? Trade-offs made? 
Have risks been reduced to acceptable level for Full-Scale Develop- 
ment? 


f. What are the operational, technical, cost, scheduling, procurement, 
and program management implications of indirect or “spillover” effects of 
the system. 


д. Have SIGSEC considerations been addressed as appropriate? 
system vulnerabilities; development and production of crypto materiel; 
coordination with NSA or has deleration of authority been obtained for 
the Army to develop required crypto materiel in support of the system? 


2. OPERATIONAL AND TECHNICAL ASSESSMENT. 


a. Proposed development vs present state-of-theart? Primarily en- 
gineering rather than experimental? 


b. Efforts planned for reliability and maintainability improvement 
to reduce O&M costs. Have reliability and maintainzbility requirements 
and thresholds been set? Contractual requirements including test provi- 
sions? Icentives? 


c. Effort planned for electromagnetic compatibiity improvement to 
minimize impact upon the spectrum. Have electromeznetic compatibility 
requirements been set? Do these requirements include test provisions? 


d. Design extended far enough in Validation Phese to identify risks? 
Name highest risk areas—how risky? Design validation of risk areas. 
Back-up programs needed? Available solutions in hand? With these risks, 
should we proceed with "hard" development contracts? 


e. Hardware and/or software testing done to redsce or remove risks? 
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What critical problems and issues earlier identified as requiring test have 
been resolved? What critical problems and issues remain to be resolved 
through test and evaluation (including OT&E) prior to procurement de- 
cision and what are the plans and schedule milestones for accomplishing. 


f. Significance of variations tn technical aspects by competing Vali- 
cation Phase contractors? How or why is winner’s proposal the best? 


g. Operational requirements and test specifications matched to pro- 
gram state-of-the-art, kind of management? Flexible enough without 
contract changes? 


h. Test and evaluation plan consistent with proposed program com- 
mitments? Integrated test program? Identify achievement milestones? 


1. Operational and technical test and evaluation issues been refined 
and submitted to DDRE for review? 


j. Is effort planned to reduce system susceptibilitv to potential hostile 
EW threat? The formal vulnerability analysis been updated? Results? 


k. Environmental pollution control features have been specifically 
reviewed and evaluated. | 


3. COST AND BENEFITS. 


a. How realistic are cost and benefits/effectiveness estimates? Basis? 
All significant cost elements (e.g., test facilities/equipment electromag- 
netic spectrum and crvptomaterial) included? Are costs expressed іп 
both constant vear and then vear dollars? 


b. Significant differences in cost estimates between Government and 
contractors? Analysis of these differences? Do thev imply uncertainties 
in real cost and performance? “Is a ‘should cost’ analysis warranted?” 


c. Have the costs in terms of required effectiveness for all or part of 
tne forces in terms of realistic contingency missions been assessed (quality 
versus quantity trade-off analvses). 


d. Have program costs been validated by COA and/or OASD (Sys- 
tems Analysis) ? 


e. What program features most affect total cost, funding rate, R&D 
vs. other funds? What program options (examples? change overall sched- 
ule, do pacing subsystems first, test more or less before production release) 
help total life cycle cost or funding? Program designed to avoid excessive 
funding peaks? Excessive early expenditures? 


f. Life cycle cost analysis for the alternative proposed programs? 
g. Is funding profile consistent with OSD/Congressional constraints ? 
h. Does a highly visibile cost trail exist thus far? 


1. Cost effectiveness versus design alternatives? 


4. SCHEDULE. 


a. Can IOC date be slipped for cost or risk reduction? 
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b. How to preserve IOC date and minimize early resource commit- 
ments? What parts of program are deferrable? For how long? Why 
are they deferrable? 


с. Realism of IOC date, i.e., will all necessary items be ready (tactics, 
trained people, facilities, supporting communications, test equipment, 
spares, etc)? Who is making these schedules mesh? Non-R&D resources 
programed? 


d. Difficulty of schedule? Pacing elements? Which ones most likely 
‘to slip? Action to reduce this risk. Effect on system(s) to be replaced? 


e. Significant differences in schedules by competitors? Analysis of 
these differences? Clues to uncertainties? 


f. Are schedules consistent with OSD/Congressional constraints? 


5. PROGRAM MANAGEMENT. 


a. What is the Army management staff for this program? Adequate? 
Project Manager tenure and that of his key personnel ? 


b. How will contractor be managed (monitor, control)? Is MIL STD 
881 and DODD 7000.1 being implemented? 


c. Government and contractor cost, schedule, technical performance 
reporting systems? How close to real time on major aspects? 


d. For Joint Service Program—have Joint Service Operating Pro- 
cedures been developed? If not explain. 


e. How will change control be managed? How will change proposals 
be reviewed to insure that they are limited to those that are necessary or 
offer significant benefit to the Army? 


f. Have discrete cost elements (e.g., unit production cost, operating 
and support cost) been translated into “design to” requirements? 


6. PROCUREMENT/ASSESSMENT. 


a. Has Advance Procurement Plan (APP) been submitted to ASA 
(T&L), ASA (R&D), and ASD (I&L) for review? 


| b. Procurement plan matched to program and risks? Contract type 
consistent with risks? Contractual Achievement Milestones ?—associ- 
ated contract options? Have provisions for formal trade-off analyses been 
incorporated into development plan? 


c. Contract negotiated while competition existed? Contract incen- 
tives? Do they motivate? Importance to us? 


d. Advantageous features of contract from Government view: Con- 
tractor's? What is Government liability at each stage of contract? 


e. Additional commitments by contractor, e.g., production options? 
Adequate flexibility for Government? 


f. What happens if contractor gets in trouble? What options does 
the Government have? 
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g. Is this a “buy-in”? Any contract features to help contractor 
“get weil”? Prevent him from “getting well”? Has suspected “buy-in” 
been discussed with bidder's top management? 


h. How did the source selection take into account the contractor’s 
capability to develop a necessary defense system on a timely and cost- 
effective basis? 


7. CONTRACTOR AND PROPOSAL. 


a. Best contractor or best proposal? How better? Strong points? 
Weak points? 


b. Difference in evaluation of competing proposals? Winner best in 
which areas? Are they the most important areas? 


c. Competence of winner and loser, judged by Validation Phase effort 
alone? Past records of competitor (cost, schedule, performance)? Other 
factors evaluated? Is-contractor’s engineering/test/production staff ade- 
quate to adhere to program objectives? 


d. RFP and reports SCRUB? Indicate what was done to scrub the 
RFP and proposal of unnecessary and marginal requirements for per- 
formance, management and data requirements. Identify the documenta- 
tion that could be reduced or eliminated. 

8. ASARC/DSARC REVIEWS INVOLVING SOURCE SELECTION. 


a. Unsuccessful bidder status? Provide summary comparing the 
proposed programs of unsuccessful bidders with winning bidder. 


b. Credibility of cost /performance proposed? 

c. Did any bidder claim that Government requirements were unrealis- 
tic? 
9. SECURITY. 


Summarize the security classification of the program, system. co - 
ponents, technical characteristics and any other aspects of the progr: a 
requiring classification. 
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CHECKLIST FOR MILESTONE lla REVIEWS 


(LOW RATE INITIAL PRODUCTION) 





Purposes of Milestone Ila ASARC/DSARC. 


The purpose of the Milestone IIa ASARC/DSARC review is to de- 
velop a recommendation for the Secretary of the Army or SEC/DEF on 
transitioning a weapon system into a low rate initial production. Such 
production is authorized for the basic purpose of obtaining a quantity of 
representative production prototype test items. The factors to be con- 
sidered in authorizing a low rate initial production of major systems in- 
volve a combination of test, development lead time, economic factors, and 
a production rate consistent with retention of the management, engineer- 
ing, and production skills which are essential to program integrity and 
learning. These factors shouid be kept in mind in following this checklist. 
The Milestone IIa review will be conducted at such time that the Army 
has determined that— 


a. Development testing and operationa! testing (DT/OT) have been 
accomplished such that important characteristics were tested sutlicientlv 
enough to indicate major developmental problems and critical operational 
issues have been or should be satisfactorily resolved by the end of develop- 
ment. 


b. The system still satisfies a valid military need or ROC, responds 
to the current threat, is still worth its projected costs, and is of sufficient 
priority to be funded within overall fiscal constraints. 


c. Initial Producibility Engineering and Planning (PEP) has been 
sufficiently conducted to indicate confidence in production planning. esti- 
mated costs and results. PEP consists of those planning and engineering 
measures undertaken to insure the timely and economic producibility of 
essential materiel. PEP generally includes data packages, e.g., engineer- 
ing drawings, bills of materials, quality assurance procedures, planning 
for plant layouts, parts lists, and descriptions of manufacturing proced- 
ures. In some cases, PEP may also include the design of some special 
purpose production equipment, tooling and computer modeling/simulation 
of manufacturing processes to confirm producibility. 


d. Development and production risks have been identified. The re- 
mainder of the development phase, development and operational testing, 
(DT/OT) and PEP will deliberately address such risks as evidenced in 
updated DCP/DPM/APM Development Plans and Coordinated Test Pro- 
grams. 
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e. System definition (specifications, drawings and associated docu- 
mentation) incorporate initial findings of the development and DT/OT 
efforts are adequate for low rate initial production purposes. When will 
competition be introduced into the production phase. If none planned, 
why? 


f. The contractual aspects are sound for the remainder of develop- 
ment and for low rate initial production. 


g. DCP/DPM/APM thresholds are sufficiently defined to assure iden- 
tification of major development and production program variances. 


h. Analyses (trade-off, threat, risk, parametric cost, cost and effect- 
iveness, Vulnerability to hostile EW and SIGINT efforts, communica- 
tions-electronics considerations, and logistic support) confirm the desir- 
ability of making the transition to low rate initial production. New analy- 
ses to support the Milestone III review and decision process are planned 
and programed. 


t. Initial issue quantity requirements for major systems will be 
displayed bv projections of the BOIP in the Structure and Composition 
System (SACS). 


J. BACKGROUND. 


а. Review program objectives including: 
(1) Significant program changes that occurred during develop- 
ment. | 


(2) Description of the original program goals (life cvcle costs, 
Schedule, and performance) compared with current expectations, to 
include how well the ‘‘design-to” estimates were met as evidenced during 
initial DT/OT. 


b. Provide brief summary of the operational need and mission require- 
ments, per revised section I of the Development Plan, including: 
(1) Concept analysis. 


(2) Cost-benefit trade-off analysis. Quantity versus quality should 
be revalidated in terms of realistic missions and forces. 





(3) Current and anticipated threat—if a range exists in the intel- 


ligence community, provide it. 

(4) Related tactics and doctrine. 

(5) Reasons for requiring a new system, including operation and 
support personnel costs as well as materiel costs and technical compari- 
sons with systems to be replaced or supplemented. 

2. OPERATIONAL AND TECHNICAL ASSESSMENT. 


Assesses the status of weapon system and the major subsystems and 
components to— 


a. Assure that necessary preproduction prototype testing to include 
operational testing is programed or pilot production technical and op- 
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erational testing is programed, both to assure the meetings of performance 
bands, specified technical criteria and those necessary to estimate opera- 
tional effectiveness, suitability (including reliability, ама БИ Ernain: 
tainability (RAM), electromagnetic compatibility, EW vulnerability, and 
traming requirements), and optimization of tactics. Assure that testing 
confirms compatibility with other systems and equipment it must operate 


within the field. Assure that testing validates the possible basis of issue 
(BOT). 


b. Establish that sufficient design and performance band achieve- 
ment milestones (prerequisites to low rate initial production) have been 
achieved, and all major problems can be identified, resolved or appropri- 
ate trade-offs made. 


c. Assure EW vulnerability testing in actual or simulated opera- 


tional EW/SIGINT environment. Assess the ability of the system to op- 
erate effectively in relation to expected EW/SIGINT threat. 


d. Contractual Reliability and Maintainability Requirements? Соп- 
tractual test provisions? Incentives? 


e. Determine the status of type classification and the T&E on which 
it was (or will be based). 


f. Determine the status of PEP and if preliminary technical data 
package (specifications, drawings, test procedures, etc.) is sufficiently 
complete, reflects the tested prototype and is adequate as a basis for low 
rate initial production. 


g. Address those operational (performance band) requirements 
which were not proved by the testing program as well as those for which 
tests indicated a performance shortfall. These characteristics should be 
acknowledged by the user and acceptability of the shortfall certified. 


h. Plan to submit Army test results and assessments, in terms o 
response to initial questions or issues previously identified, to DDRE fo 
evaluation. This will include the results of initial operational tests an 
the initial independent evaluation of operational effectiveness and sui! 
ability. 

t. Assess weapon system configuration to determine if any significant 
design changes may be required for full-scale production engineering. 


j. Environmental pollution control features have been specifically 
evaluated and an environmental impact statement (EIS) prepared, if 
appropriate. | 


8. PRODUCTION AND PROCUREMENT ASSESSMENT. 


Recognizing that significant unknowns can develop during the transi- 
tion from development to low rate initial production, the following Pro- 
ducibility Engineering and Planning (PEP) data should be furnished: 


a. Production. 
(1) Identify product assurance controls or tests established to pre- 
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vent degradation of technical design performance parameters in the 
transition from development to low rate initial production. 


(2) Outline efforts for minimizing production risks. 


(3) Identify potential production impact on other weapon sys- 
tems. 


(4) Delineate production and contract options e.g., phase down 
plans and work stoppage options, or change production schedules up or 
down. 


(5) Provide status of pilot production, if appropriate. 
(6) Provide a planned production schedule. 


(7) Provide the plan and schedules for later test and evaluation 
to be accomplished to confirm that the product does, in truth, mcet techni- 
cal criteria, that the operational test and evaluation findings remain valid, 
and that doctrine and tactics for use do optimize mission and force effect- 
iveness at least long-term costs. 


b. Producibility. 
(1) Describe production line planning. 


(2) Determine that initial facilities surveys have been completed, 
include status of accessory and ancillary items; test and training equip- 
ment. 


c. Procurement. 


(1) Identify the criteria for contractor selection. Explain how 
the source selection decision took into account the contractor's capability 
to produce a necessary defense system on a timely and cost etfective basis. 


(2) Explain the type of proposed low rate initial production con- 
tract with a review of procurement methodology employed by involved 
DOD and Army agencies and reasons therefore. This review will include a 
Summary of the procurement review process and bring out these three 
points: 

(a) Any special provisions such as Total Systems Performance 
Responsibility, Escalation, or special funding arrangements with the ra- 
tionale for their use. 

(b) That the contract, if available, or the Determinations and 
Findings (D&F), has been analyzed to insure that the interrelationship of 
provisions is understood and that they are compatible with the intent of 
the future contract. 

(c) That specifications and exhibits to the future contract have 
been reviewed for accuracy, compieteness, and compatibility in context 
with the procurement, and that they are adequate for the intended low 
rate initial production. 


(3) Describe the size of first low rate initial production buy, basis 
for quantity, follow-on quantities, and Government options. 


(4) Discuss the principal subsystems which are GFE, CFE: and 
why; provide an evaluation of the proposed vendor’s capability to produce 
these items. 
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(5) State the actions taken in the RFP to eliminate unnecessary 
and marginal performance, management and data requirements. Are there 
any reports required by directives or regulations which appear to be 
unnecessary? 


(6) Describe Value Engineering (VE) provisions to be included in 
the contract; estimate costs of these provisions. 


Note. Has a current Advance Procurement Plan been submitted to ASD(I&L)? 


(7) Describe configuration management plan and contractor per- 
formance measurement with delineated contractor and government re- 
sponsibilities and authorities. 


4. SCHEDULES. 


a. Identify features in the low rate initial production start-up sched- 
ule which minimizes financial commitments until all major development 
problems and operational issues have been resolved. Appropriate informa- 
tion from other DOD agencies involved in developing supporting sub- 
systems may be included in ASARC reviews. 


b. Depict the status of the pacing and long leadtime items. 
c. Identify possible slippage or production risk. 


d. Identify those external factors which may effect program, e.g., 
delays in delivery of GFE, labor stoppages, results of DT/OT, etc. 


e. Review the concurrency and schedules compressions as they relate 
to additional resources and management actions required, and the gains 
versus risks. 


5. COSTS. 


a. Explain fully low rate initial production cost estimates and include: 


(1) Comparison of production costs with similar programs and 
with approved DCP (DSARC I) projections. Should cost analysis (if 
appropriate). 


(2) Price out of program alternatives; indicate options to reduce 
costs expressed in terms of constant year and then year dollars. 


- (3) Cost projections including funding requirements by FY. 


b. Provide a depiction of cost estimating techniques used and in- 
clude— 


(1) OSD/Army estimates, and planned budget. 


(2) Projected escalation, system acquisition, life cycle costs, and 
logistic support costs. 


c. Define management control systems and data costs and the ap- 
proximate ratio of these costs to hardware costs. 


d. A review of cost history which traces estimates and costing factors 
including those for economic escalation. 
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:6. PROGRAM MANAGEMENT. ) 


Review the plan for overall program management to determine that 
the Army management concept is tailored to program and contract type; 
determine compliance with major OSD guidance, such as, 28 May 1970 
memorandum from Deputy Secretary of Defense, and DODD 5000.1. 


7. OTHER. 


a. Ascertain that the program proposed to go forward is consistent 
with the DCP/DPM/APM and its thresholds. 


b. Indicate that the next SAR, if required, will be consistent with 
DCP with respect to the rationale on which the production decision is 
based. 


c. Give assurance that an integrated logistic support plan complying 
with DODD 4100.35 and DODD 3224.1 has been implemented. 


d. Depict configuration control techniques. 


e. Describe management systems used to control costs, schedule, and 
technical performance; reports required. 


f. Discuss the operational, technical. scheduling, costs, procurement, 
and program management considerations of indirect or “spillover” effects 
of the system. 


g. Provide the following information, as appropriate: 


(1) Candidate contractors’ historical performance record. | \ 
(2) Status of candidate contractors’ purchasing systems, includ- "P. 
ing approval of make or buy plans. 
(3) Compliance with provisions of Armed Services Procurement 
Regulation and Public Law 87-653. 
(4) Compliance with Equal Employment Opportunity (EEO). 
(5) Proprietary Rights Issues. 
(6) Political issues and/or special congressional interest. 
(7) Description of performance incentive(s) contained in pro- 
posed low rate initial production contract. 
8. ASARC/DSARC REVIEWS INVOLVING SOURCE SELECTION. 
| Provide information comparing the proposed programs of unsuccess- 
ful bidders with the winning proposal. 
SECURITY. 
Summarize the security classification of the program, system, com- 
ponents, technical characteristics and any other aspects of the program 
requiring classification. 
10. DSARC REVIEWS. 
OSD may require special DSARC reviews between Milestones IT and 
III. This checklist is intended for such reviews and for the ASARC IIa 
review for the Army's low rate initial production decision. Ë 
| ў 
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CHECKLIST FOR MILESTONE II REVIEWS 


(END OF DEVELOPMENT AND 
BEGIN FULL-SCALE PRODUCTION) 


Purpose of Milestone ITI ASARC/DSARC. 


The purpose of the Milestone III DSARC review is to develop a recom- 
mendation for the Deputy Secretary of Defense on moving a weapon 
system into production. This review will form the basis for the decision 
to produce the system for deployment. DSARC III meetings will be held 
at such time that the Army has determined that— 


а. Engineering and operational systems development and testing, in- 
cluding the necessarv initial operational testing and evaluation have been 
substantially completed and all major development problems have been 
resolved. 


b. The cost and importance warrant production and deployment of 
the system that has been tested, evaluated by trade-off analysis and de- 
fined. | 


c. System definition (specifications, drawings and associate documen- 
tation) incorporate the total findings of the development effort and are 
adequate for production. Can competition be used for the initial produ 
tion contract? If not, why? When is competition for production plannec 


d. Schedule and cost estimates and commitments are credible ar 
acceptable. 


e. DCP thresholds are sufficiently defined to ensure identification of 
major production program variances. 


f. The production plans and personnel and logistics support plans 
are acceptable. 


g. Sufficient progress has been made toward a negotiated contract 
to justify transition to the Production Phase. 


h. Contractual conditions are sound. 


it. Analyses (trade-off, parametric cost, cost and effectiveness sup- 
ported test data) are adequate to confirm there js a need for producing 
the defense system in consideration of threat, estimated acquisition 
and ownership costs and potential benefits in context with overall Army 
Strategy and fiscal guidance. 
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j. Test data and analyses exist to assure that all previously identified у 
technical uncertainties have been resolved. 7 


k. Threat is still credible (conforms with the AAI or has been coor- 
dinated with ACSI). 


l. If a competitive program is being addressed, a clear winner has been 
established. 


n. Initial issue quantity requirements for major systems will be dis- 
played by projection of the BOIP in the Structure and Composition Sys- 
tem (SACS). 


1. BACKGROUND. 


а. Review program objectives including: 


(1) Significant program changes that occurred during development 
of the original DCP (DSARC I) program goals. 


(2) Description of the original program goals (life cycle costs, 
schedule, and performance) compared with current expectations, to in- 
clude how well the “design-to” estimates were met. 


b. Provide brief summary of the operational need and mission re- 
quirements, as reflected in the ROC, including: 


(1) Concept analysis. 
(2) Cost-benefit trade-off analysis. 


(3) Current and anticipated threat—if a range exists in the intelli- 
gence community, provide it. 


(4) Related tactics and doctrine. 


I seasons for requiring a new system, includin ration z 
(5) Reasons f q g ystem, luding operation and 
support personnel costs as well as materiel costs and technical compari- 
sons with systems to be replaced or supplemented. 


2. OPERATIONAL AND TECHNICAL ASSESSMENT. 


a. Status of development. Review the status of weapon system and 
the major subsystems and components to— 


(1) Assure that necessary preproduction prototype testing to in- 
clude operational testing is completed or pilot production technical and 
operational testing is completed, both to assure tlie meeting of specified 
technical criteria and those necessary to estimate operational effective- 
ness, suitability (including reliability, maintainability and training re- 
quirements), and optimization of tactics. Assure that testing validates 
the BOI and confirms compatibility with other systems and equipment it 
will operate with in the field. 


(2) Establish that all the design and performance band achieve- 
ment milestones (prerequisites to production) have been achieved, and all 
major problems resolved or appropriate trade-offs made. 


(3) Contractual Reliability and Maintainability requirements? 
Contractual test provisions? Incentives? 
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criteria, that the initial operational test and evaluation findings remain 
valid, and that doctrine and tactics for use do optimize mission effective- 
ness at least long-term costs. Assure that testing validates the BOI and 
confirms the compatibility of the system with other systems and equip- 
ment it must operate within the field. 


b. Producibility. 


(1) Describe the readiness of the production line. 


(2) Determine that facilities surveys have been completed, include 
status of accessory and ancillary items; test and training equipment. 


c. Procurement. 


(1) Identify the criteria for contractor selection. Explain how the 
source selection decision took into account the contractor’s capability to 
produce a necessary defense system on a timely and cost effective basis. 


(2) Explain the type of proposed production contract with a re- 
view of procurement methodology and reasons therefore. This review will 
include a summary of the procurement review process and bring out 
these three points: 


(a) Any special provisions such as total systems performance re- 
sponsibility, escalation, or special funding arrangements with the rationale 
for their use. 


(b) That the contract has been analyzed to insure that the inter- 
relationship of provisions is understood and that they are compatible with 
the intent of the contract. 


(c) That specifications and exhibits to the contract have been 
reviewed for accuracy, completeness, and compatibility in context with 
the procurement, and that they are adequate for the intended production. 


(3) Describe the size of first production buy, basis for quantity, 
follow-on quantities, and Government options. 

(4) Discuss the principal subsystem which are GFE, CFE: and 
why; provide an evaluation of the vendor’s capability to produce these 
items. | 


(5) State the actions taken in the RFP to eliminate unnecessary 
and marginal performance, management and data requirements. Are there 
any reports required by directives or regulations which appear to be un- 
necessary ? 

(6) Provide environmental impact statements (EIS) for each 
procurement alternative, if appropriate. 

(T) Describe Value Engineering (VE) provisions to be included in 
the contract; estimate costs of these provisions. 


Note. Has a current Advance Procurement Plan been submitted to ASD(I&L)? 


(8) Describe configuration management plan with delineated con- 
tractor government responsibilities and authorities. 


(9) Assure that a production unit cost has been incorporated in 
the RFP. I 
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criteria, that the initial operational test and evaluation findings remain 
valid, and that doctrine and tactics for use do optimize mission effective- 
ness at least long-term costs. Assure that testing validates the BOI and 
confirms the compatibility of the system with other systems and equip- 
ment it must operate within the field. 


b. Producibility. 


(1) Describe the readiness of the production line. 


(2) Determine that facilities surveys have been completed, include 
status of accessory and ancillary items; test and training equipment. 


c. Procurement. 


(1) Identify the criteria for contractor selection. Explain how the 
source Selection decision took into account the contractor’s capability to 
produce a necessary defense system on a timely and cost effective basis. 


(2) Explain the type of proposed production contract with a re- 
view of procurement methodology and reasons therefore. This review will 
include a summary of the procurement review process and bring out 
these three points: 


(a) Any special provisions such as total systems performance re- 
sponsibility, escalation, or special funding arrangements with the rationale 
for their use. 

(b) That the contract has been analyzed to insure that the inter- 
relationship of provisions 1s understood and that they are compatible with 
the intent of the contract. 


(c) That specifications and exhibits to the contract have been 
reviewed for accuracy, completeness, and compatibility in context with 
the procurement, and that they are adequate for the intended production. 


(3) Describe the size of first production buy, basis for quantity, 
follow-on quantities, and Government options. 

(4) Discuss the principal subsystem which are GFE, CFE: and 
why; provide an evaluation of the vendor’s capability to produce these 
items. | 

(5) State the actions taken in the RFP to eliminate unnecessary 
and marginal performance, management and data requirements. Are there 
any reports required by directives or regulations which appear to be un- 
necessary ? 

(6) Provide environmental impact statements (EIS) for each 
procurement alternative, if appropriate. 

(7) Describe Value Engineering (VE) provisions to be included in 
the contract; estimate costs of these provisions. 


Note. Has a current Advance Procurement Plan been submitted to ASD(I&L)? 


(8) Describe confizuration management plan with delineated con- 
tractor government responsibilities and authorities. 


(9) Assure that a production unit cost has been incorporated in 
the RFP. 
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4. SCHEDULES. 


a. Identify features in the production start-up schedule which mini- 
mize financial commitments until all major development problems and 
operational issues have been resolved. 


b. Depict the status of the pacing items. 
c. Identify possible slippage. 


d. Identify those external factors which may effect program, e.g., 
delays in delivery of GFE, labor stoppages, etc. 


e. Review the concurrency and schedules compression as they relate 
to additional resources and management actions required, and the gains 
versus risks. 


5. COSTS. 


a. Explain fully production cost estimates and include: 


(1) Comparison of production costs with similar programs and 
with approved DCP (DSARC I) projections. Should cost analysis if ap- 
propriate. 


(2) Price out of program alternatives; indicate options to reduce 
costs, expressed in terms of constant vear and then year dollars. 


(3) Cost projections including funding requirements by FY. 
b. Provide a depiction of cost estimating techniques used and in- 
clude: 


(1) OSD/Army estimates, contractor’s estimate, and planned bud- 
get. 


(2) Projected escalation, system acquisition, life cycle costs, and 
logistic support costs. 


c. Define data costs and the approximate ratio of data costs to hard- 
ware costs. 


d. A review of cost history which traces estimates and costing factors 
including those for economic escalation. 


6. PROGRAM MANAGEMENT. 


Review the plan for overall procram management to determine that 
the Army management concept is tailored to program and contract type; 
determine compliance with major OSD guidance, such as, 28 May 1970 


memorandum from Deputy Secretary of Defense, and DODD 5000.1. 


u OTHER. 


а. Ascertain that the program proposed to go forward is consistent 
with the DCP/DPM/APM and its thresholds. 


b. Indicate that the SAR is consistent with DCP with respect to the 
rationale on which the production decision Is based. 
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c. Give assurance that an integrated logistic support plan complying 
with DODD -1100.35 and DODD 3224.1 has been implemented. 


d. Depict configuration control techniques. 


e. Describe management systems used to control costs, schedule, and 
technical performance; reports required. 


f. Discuss the operational, technical, scheduling, costs, procurement 


and program management considerations of indirect or “spillover” effects 


of the system. 


g. Provide the following information, as appropriate: 
(1) Contractor’s historical performance record. 


(2) Status of contractor’s purchasing system, including approval 
of make or buy plans. 


(3) Compliance with provisions of Armed Services Procurement 
Regulation and Public Law 87-653. 


(4) Compliance with Equal Employment Opportunity (EEO). 
(5) Proprietary Rights Issues. 
(6) Political issues and/or special congressional interest. 


(7) Description of performance incentive(s) contained in con- 
tract. 


PASA RC/DSARC REVIEWS INVOLVING SOURCE SELECTION. 


Provide information comparing the proposed programs of unsuccess- 
ful bidders with the winning proposal. 


SECURITY. 


Summarize the security classification of the program, system, com- 
ponents, technical characteristics and any other aspects of the program 
requiring classification. 
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